-- Logs begin at Thu 2022-06-23 07:36:45 UTC, end at Thu 2022-06-23 08:44:59 UTC. -- Jun 23 08:11:50.071459 dv-cinder-847216-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 08:11:50.081807 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 08:11:50 2022] *** Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: nodename: dv-cinder-847216-2-iscsi Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: machine: x86_64 Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: clock source: unix Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: pcre jit disabled Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: detected number of CPU cores: 4 Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: current working directory: / Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: detected binary path: /usr/bin/uwsgi-core Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: your processes number limit is 47680 Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: your memory page size is 4096 bytes Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: detected max file descriptor number: 2048 Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: lock engine: pthread robust mutexes Jun 23 08:11:50.082392 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: thunder lock: enabled Jun 23 08:11:50.083426 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 08:11:50.083426 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 08:11:50.125990 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: Python main interpreter initialized at 0x564f1a8789c0 Jun 23 08:11:50.125990 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: python threads support enabled Jun 23 08:11:50.125990 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: your server socket listen backlog is limited to 100 connections Jun 23 08:11:50.125990 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: your mercy for graceful operations on workers is 90 seconds Jun 23 08:11:50.126343 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 08:11:50.126418 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: *** Operational MODE: preforking *** Jun 23 08:11:50.126669 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: *** uWSGI is running in multiple interpreter mode *** Jun 23 08:11:50.126669 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: spawned uWSGI master process (pid: 103243) Jun 23 08:11:50.126859 dv-cinder-847216-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 08:11:50.127935 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: spawned uWSGI worker 1 (pid: 103244, cores: 1) Jun 23 08:11:50.127935 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: spawned uWSGI worker 2 (pid: 103245, cores: 1) Jun 23 08:11:50.127935 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 08:11:50.775840 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 08:11:50.786910 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 08:11:51.879706 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:11:51.879706 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: from cryptography.utils import int_from_bytes Jun 23 08:11:51.880476 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:11:51.880476 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: from cryptography.utils import int_from_bytes Jun 23 08:11:51.887781 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:11:51.887781 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: from cryptography.utils import int_from_bytes Jun 23 08:11:51.888249 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:11:51.888249 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: from cryptography.utils import int_from_bytes Jun 23 08:11:54.350039 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 08:11:54.350685 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 08:11:54.350775 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 08:11:54.351139 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 08:11:54.351384 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 08:11:54.351781 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.352101 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.352414 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.352727 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.353058 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.353387 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.353725 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.354039 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.354362 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.354618 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.354911 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.355232 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847216-2-iscsi {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.355560 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.355669 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 08:11:54.356040 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 08:11:54.356120 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.356120 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.356380 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 08:11:54.356518 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.356678 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 08:11:54.356816 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.356957 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 08:11:54.357083 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.357312 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.357477 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.357606 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.357784 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.357926 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.359193 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.359460 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.359460 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.359833 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.359985 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.360161 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.360414 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.360780 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.366741 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.366957 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.367137 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.367746 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.367746 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.368083 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.368083 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.368373 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.368373 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847216-2-iscsi {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.368671 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.368960 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.369512 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.369662 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.369790 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847216-2-iscsi {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.369933 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.370059 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.370192 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.370324 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.370447 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.370570 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.370737 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.370870 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.371008 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.371139 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.371286 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.371442 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.371574 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.371698 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.371820 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.371949 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.372079 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.372211 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.372337 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.372459 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.372589 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.372723 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.372861 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.372985 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.373194 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.373322 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.373463 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.373587 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.373723 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.373847 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.373981 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.374118 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.374118 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.374350 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847216-2-iscsi {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.374473 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.374595 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.374728 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.374852 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.374975 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.375103 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.375248 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.375374 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.375512 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.375637 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.375759 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.375888 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.376019 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.376156 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.376281 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.376281 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.376518 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.376648 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.376772 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.376904 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.377029 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.377159 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.377282 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.377412 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.377549 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.377673 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.377795 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.377924 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.378047 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.378169 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.378303 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.378428 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.378565 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.378698 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.378698 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.378931 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.379062 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.379187 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.379187 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.379464 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.379597 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.379729 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.379861 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.379991 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.380114 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.380236 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.380367 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.380499 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.380623 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.380757 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.380881 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.381004 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.381133 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.381266 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.381391 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.381513 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.381635 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.381766 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.381899 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.382022 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.382144 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.382267 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.382389 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.382510 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.382647 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.382772 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.382894 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.383023 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.383147 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.383284 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.383420 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.383552 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.383681 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.383803 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.383932 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.384056 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.384188 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.384320 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385033 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385172 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385306 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385432 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385574 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385701 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385701 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385943 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.385943 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.386200 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.386324 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.386447 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.386447 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.386687 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.386812 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.386942 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.387067 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.387189 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.387360 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.387494 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.387630 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.387763 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.387887 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.388010 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.388139 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.388263 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.388385 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.388519 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.388643 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.388765 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.388887 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.389009 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.389142 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.389274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.389409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.389533 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.389655 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.389776 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.389908 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.390033 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.390166 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.390290 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.390412 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.390543 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.390675 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.390800 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.390930 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.391053 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.391175 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.391329 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.391463 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.391589 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.391719 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.391849 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.391981 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.392104 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.392237 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.392369 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.392501 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.392625 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.392747 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.392868 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.392999 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.393123 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.393246 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.393367 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.393489 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.393620 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.393751 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.393875 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.394005 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.394143 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.394266 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.394398 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.394522 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.394650 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.394774 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.394904 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.395106 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.395106 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.395396 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.395519 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.395641 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.395762 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.395894 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.396027 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.396161 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.396286 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.396417 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.396541 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.396671 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.396804 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.396928 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.397072 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.397234 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.397359 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.397483 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.397620 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.397745 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.397868 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.397990 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.397990 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.398232 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.398357 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.398491 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.398616 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.398738 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.398862 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.398998 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.399129 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.399281 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.399408 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.399530 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.399652 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.399787 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.399913 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.400080 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.400631 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.400769 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.400892 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.401027 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.401159 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.401285 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.401418 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.401544 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.401672 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.401797 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.401919 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.402031 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.402152 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.402275 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.402412 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.402546 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.402678 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.402803 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.402933 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:11:54.403067 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.403201 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.403387 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.403513 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.403636 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.403759 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.403881 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.404015 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.404140 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.404262 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.404415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.404550 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.404675 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.404813 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.404940 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.405063 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.405186 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.405316 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.405440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.405571 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.405696 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.405827 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.405951 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.406081 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.406219 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.406344 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.406476 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.406607 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.406731 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.406853 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.406985 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.407109 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.407251 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.407377 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.407500 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.407633 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.407766 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.407890 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.408025 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.408148 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.408270 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.408392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.408524 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.408649 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.408779 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.408910 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.409035 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.409172 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.409297 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.409418 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.409541 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.409663 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.409785 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.409927 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.410054 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.410189 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.410314 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.410314 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.410554 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.410691 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.410816 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.410938 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.411070 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.411195 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.411374 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.411520 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.411646 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.411768 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.411898 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.412022 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.412144 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.412267 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.412390 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.412519 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.412643 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.412765 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.412896 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.413028 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.413152 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.413283 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.413407 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.413529 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.413730 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.413864 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.413989 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.414112 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.414239 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.414363 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.414494 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.414618 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.414741 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.414872 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.414996 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.415133 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.415272 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.415401 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.415522 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.415953 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.416088 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.416275 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.416409 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.416541 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.416674 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.416799 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.416922 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.417053 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.417178 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.417292 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.417414 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.417537 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.417666 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.417799 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.417931 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.418056 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.418187 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.418311 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.418443 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.418568 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.418697 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.418830 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.418954 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.419077 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.419241 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.419368 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.419492 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.419614 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.419752 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.419886 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.420020 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.420145 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.420279 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.420404 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.420528 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.420651 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.420782 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.420907 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.421029 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.421152 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.421275 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.421397 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.421529 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.421654 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.421777 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.421908 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.422032 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.422164 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.422288 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.422411 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.422533 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.422658 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.422780 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.422911 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.423035 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.423158 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.423294 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.423417 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.423551 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.423686 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.423819 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.423957 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.424082 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.424204 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.424336 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.424464 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.424594 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.424719 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.424849 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.424973 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.425105 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.425238 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.425363 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.425493 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.425616 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.425723 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.425859 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.425984 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.426107 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.426229 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.426352 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.426486 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.426620 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.426753 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.426879 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.427002 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.427125 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.427292 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.427423 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.427549 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.427672 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.427802 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.427928 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.428060 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.428184 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.428307 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.428429 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.428551 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.428673 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.428805 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.428931 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.429062 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.429196 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.429320 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.429443 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.429574 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.429699 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.429811 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.429941 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.430065 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.430186 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.430322 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.430449 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.430571 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.430693 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.430815 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.430952 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.431078 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.431243 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.431532 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.431931 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.432060 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.432203 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.432341 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.432476 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.432601 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.432726 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.432848 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.432984 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.433111 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.433243 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.433375 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.433500 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.433623 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.433763 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.433888 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.434011 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.434134 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.434260 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.434391 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.434516 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.434639 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.434775 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.434900 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.435024 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.435156 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.435336 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.435498 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.435625 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.435750 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.435909 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.436050 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.436236 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.436373 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.436548 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.436677 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.436867 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.437006 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.437174 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.437303 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.437484 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.437611 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.437789 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.437930 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.438086 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.438214 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.438387 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.438514 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.438723 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.438858 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.438986 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.439118 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.439278 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.439407 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.439577 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.439707 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.439888 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.440020 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.440192 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.440320 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.440492 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.440628 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.440792 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.440920 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.441092 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.441217 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.441402 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.441532 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.441703 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.441828 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.442022 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.442158 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.442338 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.442465 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.442643 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.442770 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.442942 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.443078 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.443277 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.443407 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.443583 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.443709 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.443882 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.444020 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.444180 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.444307 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.444478 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.444614 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.444785 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.444921 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.445098 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.445227 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.445397 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.445527 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.445703 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.445831 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.446006 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.446133 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.446309 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.446435 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.446613 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.446742 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.446958 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.447291 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.447686 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.447815 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.447954 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448081 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448203 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448311 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448426 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448533 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448654 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448762 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448867 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.448972 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.449077 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.449190 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.449362 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.449495 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.449655 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.449783 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.449957 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.450097 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.450262 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.450391 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.450568 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.450701 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.450870 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.451008 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.451174 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.451347 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.451510 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.451654 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.451879 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.452080 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.452211 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.452405 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.452532 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.452718 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.452856 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.453033 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.453163 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.453344 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.453481 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.453656 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.453794 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.453979 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.454108 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.454290 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.454416 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.454596 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.454737 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.454907 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.455044 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.455229 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.455358 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.455535 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.455664 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.455836 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.455966 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.456143 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.456273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.456444 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.456571 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.456744 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.456873 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.457045 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.457173 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.457344 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.457468 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.457686 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.457817 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.457940 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.458064 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.458222 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.458500 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.458630 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.458815 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.458939 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.459113 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.459275 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.459443 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.459573 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.459741 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.459867 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.460057 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.460190 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.460361 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.460490 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.460660 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.460788 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.460956 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.461083 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.461251 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.461393 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.461584 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.461724 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.461885 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.462013 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.462192 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.462399 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.462568 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.463156 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.463156 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.463467 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.463609 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.463736 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.463860 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.463983 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.464106 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.464229 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.464363 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.464488 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.464622 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.464747 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.464884 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.465010 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.465147 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.465281 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.465406 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.465529 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.465654 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.465777 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.465910 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.466036 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.466159 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.466282 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.466405 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.466541 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.466668 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.466847 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.466976 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.467150 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.467313 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.467480 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.467611 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.467783 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.467911 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.468117 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.468243 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.468416 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.468563 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.468703 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.468830 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.469000 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.469128 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.469300 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.469437 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.469594 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.469730 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.469896 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.470033 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.470191 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.470320 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.470499 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.470636 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.470806 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.470951 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.471077 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.471201 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.471393 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.471521 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.471695 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.471836 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.471997 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.472125 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.472292 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.472428 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.472609 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.472751 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.472913 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.473041 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.473209 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.473344 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.473503 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.473632 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.473803 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.473930 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.474100 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.474228 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.474396 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.474525 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.474697 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.474824 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.474997 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.475125 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.475322 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.475454 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.475618 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.475743 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.475921 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.476049 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.476218 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.476355 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.476515 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.476641 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.476811 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.476946 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.477110 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.477236 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.477405 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.477532 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.477701 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.477838 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.477996 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.478205 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.478618 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.478974 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.479101 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.479259 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.479401 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.479528 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.479661 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.479785 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.479908 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.480041 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.480174 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.480299 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.480441 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.480568 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.480700 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.480825 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.480953 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.481076 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.481199 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.481322 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.481456 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.481589 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.481713 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.481880 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.482008 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.482195 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.482333 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.482499 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.482613 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.482838 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.482957 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.483106 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.483260 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.483436 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.483551 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.483741 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.483855 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.484048 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.484164 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.484349 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.484463 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.484650 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.484765 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.484950 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.485080 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.485252 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.485366 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.485553 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.485666 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.485865 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.485979 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.486173 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.486285 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.486477 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.486591 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.486773 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.486886 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.487071 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.487190 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.487416 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.487524 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.487690 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.487806 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.487994 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.488121 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.488300 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.488437 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.488606 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.488733 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.488910 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.489037 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.489214 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.489350 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.489519 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.489648 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.489822 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.489948 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.490124 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.490329 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.490446 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.490567 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.490721 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.490847 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.491021 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.491156 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.491708 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.491827 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.491945 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.492054 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.492254 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.492380 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.492564 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.492688 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.492861 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.492979 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.493167 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.493294 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.493468 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.493594 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.493837 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.494147 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.494564 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.494694 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.494819 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.494942 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.495066 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.495189 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.495357 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.495485 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.495609 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.495732 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.495864 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.495998 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.496124 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.496257 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.496382 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.496514 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.496649 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.496784 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.496921 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.497047 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.497171 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.497294 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.497418 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.497551 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.497679 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.497834 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.497990 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.498135 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.498296 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.498433 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.498619 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.498747 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.498929 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.499064 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.499252 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.499383 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.499565 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.499694 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.499869 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.499996 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.500178 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.500307 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.500481 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.500615 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.500884 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.501011 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.501191 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.501320 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.501490 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.501626 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.501797 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.501923 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.502118 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.502248 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.502410 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.502537 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.502723 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.502859 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.503470 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.503616 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.503727 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.503834 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.503834 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504037 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504145 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504248 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504351 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504568 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504680 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504881 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.504995 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.505186 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.505300 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.505494 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.505617 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.505793 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.505906 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.506111 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.506225 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.506412 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.506526 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.506713 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.506826 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.507025 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.507144 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.507352 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.507481 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.508157 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.508286 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.508286 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.508533 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.508661 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.508798 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.508932 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.509067 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.509201 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.509550 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.509794 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.509931 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.510057 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.510266 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.510391 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.510523 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.510639 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.510771 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.510895 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.511030 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.511155 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.511301 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.511440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.511567 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.511690 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.511828 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.511953 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.512081 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.512219 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.512345 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.512471 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.512602 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.512735 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.512862 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.513000 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.513126 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.513240 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.513372 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.513498 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.513655 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.513793 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.513970 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.514107 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.514284 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.514417 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.514600 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.514730 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.514901 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.515030 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.515199 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.515386 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.515525 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.515652 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.515798 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.515926 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.516129 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.516257 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.516426 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.516555 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.516738 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.516865 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.517061 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.517188 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.517381 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.517524 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.517685 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.517812 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.517987 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.518123 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.518298 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.518425 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.518606 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.518735 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.518913 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.519049 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.519230 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.519362 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.519535 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.519662 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.519834 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.519976 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.520137 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.520265 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.520434 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.520561 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.520732 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.520869 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.521028 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.521158 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.521330 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.521465 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.521609 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.521735 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.521907 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.522036 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.522202 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.522330 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.522521 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.522651 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.522818 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.522954 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.523117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.523274 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.523446 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.523587 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.523742 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.523869 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.524037 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.524172 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.524333 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.524462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.524665 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.524793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.524980 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.525302 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.525302 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.525828 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.525952 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.526075 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.526197 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.526335 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.526463 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.526587 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.526709 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.526839 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.526965 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.527102 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.527263 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.527398 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.527572 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.527700 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.527875 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.528013 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.528178 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.528306 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.528478 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.528614 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.528785 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.528912 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.529072 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.529199 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.529372 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.529499 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.529671 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.529799 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.529989 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.530116 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.530289 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.530416 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.530605 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.530839 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.530967 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.531162 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.531340 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.531497 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.531639 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.531799 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.531926 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.532109 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.532243 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.532421 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.532555 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.532727 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.532853 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.533032 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.533159 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.533337 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.533473 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.533641 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.533778 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.533946 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.534075 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.534264 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.534402 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.534575 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.534702 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.534888 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.535024 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.535200 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.535383 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.535547 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.535674 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.535828 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.536039 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.536167 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.536291 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.536413 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.536536 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.536733 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.536869 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.537047 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.537174 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.537349 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.537474 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.537657 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.537786 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.537967 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.538195 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.538322 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.538520 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.538661 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.538833 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.538968 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.539143 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.539290 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.539475 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.539614 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.539781 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.539911 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.540085 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.540220 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.540392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.540522 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.540800 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.541063 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.541063 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.541604 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.541740 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.541866 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.542000 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.542128 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.542254 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.542386 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.542526 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.542662 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.542788 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.542920 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.543045 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.543374 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.543508 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.543634 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.543774 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.543900 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.544024 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.544156 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.544285 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.544435 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.544564 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.544741 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.544873 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.545049 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.545177 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.545360 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.545496 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.545657 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.545793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.545952 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.546081 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.546257 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.546390 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.546560 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.546701 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.546859 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.546987 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.547164 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.547313 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.547492 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.547634 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.547790 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.547917 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.548099 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.548226 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.548400 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.548528 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.548736 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.548925 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.549053 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.549269 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.549405 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.549580 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.549718 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.549900 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.550035 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.550220 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.550448 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.550578 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.550767 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.550896 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.551101 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.551275 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.551437 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.551565 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.551738 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.551876 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.552049 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.552197 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.552356 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.552492 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.552659 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.552788 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.552957 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.553094 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.553264 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.553394 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.553563 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.553690 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.553862 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.554001 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.554166 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.554301 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.554461 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.554588 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.554781 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.554922 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.555080 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.555227 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.555405 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.555532 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.555705 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.555844 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.556010 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.556275 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.556808 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.556949 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.557086 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.557213 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.557338 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.557501 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.557626 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.557759 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.557896 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.558022 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.558146 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.558269 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.558393 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.558516 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.558649 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.558818 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.558948 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.559113 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.559272 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.559440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.559570 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.559748 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.559874 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.560051 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.560179 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.560354 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.560483 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.560659 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.560794 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.560964 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.561090 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.561264 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.561392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.561570 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.561708 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.561872 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.562010 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.562176 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.562312 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.562490 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.562625 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.562791 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.562928 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.563094 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.563357 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.563488 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.563689 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.563817 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.564006 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.564136 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.564307 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.564435 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.564610 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.564746 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.564921 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.565050 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.565217 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.565345 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.565516 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.565653 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.565836 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.566034 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.566170 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.566436 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.566562 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.566743 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.567050 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.567178 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.567384 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.567647 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.567776 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.567981 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.568239 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.568370 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.568577 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.568807 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.568937 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.569170 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.569345 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.569474 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.569761 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.569888 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.570070 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.570393 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.570522 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.570763 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.570906 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.571082 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.571265 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.571432 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.571561 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.571749 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.571936 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.572155 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.572743 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.572887 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.573015 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.573140 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.573140 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.573384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.573591 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.573721 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.573835 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.573960 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.574083 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.574216 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.574342 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.574466 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.574619 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.574780 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.574930 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.575072 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.575269 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.575401 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.575586 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.575717 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.575890 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.576029 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.576205 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.576341 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.576522 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.576650 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.576828 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.576958 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.577141 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.577269 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.577447 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.577575 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.577770 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.577900 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.578091 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.578226 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.578398 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.578535 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.578706 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.578836 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.579004 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.579133 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.579325 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.579467 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.579626 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.579756 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.579930 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.580058 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.580243 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.580379 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.580546 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.580674 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.580844 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.580973 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.581142 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.581280 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.581444 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.581572 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.581741 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.581868 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.582039 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.582178 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.582339 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.582476 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.582638 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.582768 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.582939 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.583070 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.583256 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.583388 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.583557 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.583685 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.583852 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.583982 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.584148 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.584278 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.584443 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.584571 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.584739 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.584869 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.585039 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.585168 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.585335 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.585473 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.585631 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.585786 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.585913 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.586108 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.586237 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.586419 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.586548 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.586736 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.586864 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.587045 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.587173 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.587404 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.587672 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.588227 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.588338 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.588464 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.588590 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.588725 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.588853 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.588985 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.589110 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.589241 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.589378 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.589504 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.589628 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.589751 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.589875 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.589999 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.590132 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.590262 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.590396 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.590522 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.590645 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.590770 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.590907 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.591040 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.591166 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.591342 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.591468 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.591642 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.591782 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.591945 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.592072 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.592245 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.592372 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.592549 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.592679 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.592847 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.592974 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.593146 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.593274 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.593443 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.593586 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.593741 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.593869 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.594042 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.594169 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.594341 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.594470 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.594646 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.594773 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.594945 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.595088 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.595266 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.595408 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.595568 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.595696 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.595867 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.596004 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.596167 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.596303 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.596495 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.596623 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.596805 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.596942 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.597120 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.597248 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.597438 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.597564 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.597744 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.597882 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.598059 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.598185 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.598367 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.598497 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.598685 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.598816 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.598995 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.599115 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.599327 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.599468 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.599635 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.599765 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.599957 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.600128 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.600262 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.600394 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.600535 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.600660 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.600785 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 08:11:54.600914 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.601152 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.601458 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.601765 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.602086 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.602406 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.602710 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.603034 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.603401 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.603864 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.604099 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.604409 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.604736 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.605046 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.605357 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.605672 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.605979 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.606285 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.606598 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.606911 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.607253 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.607584 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.607895 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.608218 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.608543 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.608885 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.609196 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.609536 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.609859 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.610171 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.610480 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.610782 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:11:54.611026 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 08:11:54.662589 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO dbcounter [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Registered counter for database nova_api Jun 23 08:11:54.765349 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO dbcounter [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Registered counter for database nova_api Jun 23 08:11:54.776146 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG oslo_db.sqlalchemy.engines [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:11:54.783028 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writer thread running {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:11:54.786042 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_db.sqlalchemy.engines [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:11:54.793057 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writer thread running {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:11:54.838766 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.context [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57905a20-3dbc-4820-af6f-859fc1a10707(cell1) {{(pid=103244) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 08:11:54.842725 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:11:54.844359 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:11:54.845134 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:11:54.847181 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:11:54.849199 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO dbcounter [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Registered counter for database nova_cell0 Jun 23 08:11:54.849677 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.context [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57905a20-3dbc-4820-af6f-859fc1a10707(cell1) {{(pid=103245) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 08:11:54.853193 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO dbcounter [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Registered counter for database nova_cell1 Jun 23 08:11:54.853655 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:11:54.855237 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:11:54.856115 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:11:54.857955 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:11:54.860000 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO dbcounter [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Registered counter for database nova_cell0 Jun 23 08:11:54.860978 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG oslo_db.sqlalchemy.engines [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:11:54.864223 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO dbcounter [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Registered counter for database nova_cell1 Jun 23 08:11:54.864457 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG oslo_db.sqlalchemy.engines [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:11:54.867724 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writer thread running {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:11:54.872245 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_db.sqlalchemy.engines [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:11:54.872398 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writer thread running {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:11:54.873057 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_db.sqlalchemy.engines [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:11:54.879942 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writer thread running {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:11:54.881378 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writer thread running {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:11:55.026137 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO dbcounter [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Registered counter for database nova_cell0 Jun 23 08:11:55.027362 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO dbcounter [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Registered counter for database nova_cell0 Jun 23 08:11:55.034341 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG oslo_db.sqlalchemy.engines [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:11:55.036174 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_db.sqlalchemy.engines [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:11:55.039504 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writer thread running {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:11:55.041057 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writer thread running {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:11:55.374753 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: WARNING keystonemiddleware.auth_token [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 08:11:55.375367 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: WARNING keystonemiddleware.auth_token [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 08:11:55.382060 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: WARNING keystonemiddleware.auth_token [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 08:11:55.382385 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: WARNING keystonemiddleware.auth_token [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 08:11:55.719675 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: WARNING keystonemiddleware.auth_token [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 08:11:55.719908 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: WARNING keystonemiddleware.auth_token [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 08:11:55.725557 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: WARNING keystonemiddleware.auth_token [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 08:11:55.725737 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: WARNING keystonemiddleware.auth_token [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 08:11:55.730898 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f1a8789c0 pid: 103244 (default app) Jun 23 08:11:55.731033 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f1a8789c0 pid: 103245 (default app) Jun 23 08:11:55.733030 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:11:55.734223 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-f724fe15-32ef-422e-857e-0b31b5e319f5 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001765 Jun 23 08:11:55.734641 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Jun 23 08:11:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:10.760499 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:10.762646 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003301 Jun 23 08:13:10.768433 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:10 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:10.775416 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_api:SELECT=3 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:13:10.777144 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_cell1:SELECT=3 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:13:10.778049 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_cell0:SELECT=3 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:13:10.778803 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:13:11.198242 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-c16e1a62-d634-48c8-94d5-904377b62644 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:11.229921 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-c16e1a62-d634-48c8-94d5-904377b62644 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.460114 Jun 23 08:13:11.239330 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 23 08:13:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:13.283535 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:13.285204 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-af2df02b-fc75-4353-9578-72f93ff82281 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002246 Jun 23 08:13:13.285705 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:13.343932 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-e90bb841-cfa4-4175-a187-ad33d0b20ad7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "disk": 1}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:13.362777 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 08:13:13.362777 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: warnings.warn(msg) Jun 23 08:13:13.393632 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-e90bb841-cfa4-4175-a187-ad33d0b20ad7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101747 Jun 23 08:13:13.394434 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:13:13.407670 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_api:SELECT=3 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:13:13.408614 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_cell0:SELECT=3 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:13:13.409889 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_cell1:SELECT=3 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:13:13.410908 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:13:13.613001 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-94a7f87c-6cc5-4c68-b7dd-f7a141a95340 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:13.616187 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 08:13:13.616187 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: warnings.warn(msg) Jun 23 08:13:13.680958 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-94a7f87c-6cc5-4c68-b7dd-f7a141a95340 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278484 Jun 23 08:13:13.690282 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 08:13:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:15.748755 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-e90bb841-cfa4-4175-a187-ad33d0b20ad7 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:15.750262 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-e90bb841-cfa4-4175-a187-ad33d0b20ad7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002977 Jun 23 08:13:15.750665 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:15.860952 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d5463af6-77c6-45d0-8aac-490dca6577e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:15.878777 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 08:13:15.878777 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: warnings.warn(msg) Jun 23 08:13:15.898831 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-d5463af6-77c6-45d0-8aac-490dca6577e5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139688 Jun 23 08:13:15.899602 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:13:15.911161 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-4874234e-07f4-4d4d-9945-00e807aade9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:15.912850 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 08:13:15.912850 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: warnings.warn(msg) Jun 23 08:13:15.947521 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-4874234e-07f4-4d4d-9945-00e807aade9b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039992 Jun 23 08:13:15.948104 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 08:13:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:18.030527 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d5463af6-77c6-45d0-8aac-490dca6577e5 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:18.031502 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-d5463af6-77c6-45d0-8aac-490dca6577e5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 23 08:13:18.032053 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:18.098959 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-226626f9-f280-4e37-9018-0f6f762caa81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "disk": 10, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:18.119093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-226626f9-f280-4e37-9018-0f6f762caa81 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081122 Jun 23 08:13:18.119674 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:13:18.131825 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-45577efc-91d0-4dc1-91c3-67db5443607b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:18.156080 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-45577efc-91d0-4dc1-91c3-67db5443607b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028040 Jun 23 08:13:18.156661 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 08:13:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:20.238410 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-226626f9-f280-4e37-9018-0f6f762caa81 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:20.240255 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-226626f9-f280-4e37-9018-0f6f762caa81 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Jun 23 08:13:20.240681 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:20.300167 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-a9a4576e-84d9-460e-b825-5e176186e30b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:20.318725 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-a9a4576e-84d9-460e-b825-5e176186e30b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071773 Jun 23 08:13:20.319601 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:13:20.331558 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-6bf56be1-32df-4b50-99c0-dfd205e06c84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:20.355263 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-6bf56be1-32df-4b50-99c0-dfd205e06c84 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027416 Jun 23 08:13:20.355765 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 08:13:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:22.409563 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-a9a4576e-84d9-460e-b825-5e176186e30b admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:22.410778 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-a9a4576e-84d9-460e-b825-5e176186e30b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Jun 23 08:13:22.411701 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:22.472995 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-f6cbe8ac-24cd-43ba-8070-c7893d5b9012 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "ram": 4096}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:22.493205 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-f6cbe8ac-24cd-43ba-8070-c7893d5b9012 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075447 Jun 23 08:13:22.493945 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:13:22.506163 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-0cdce41c-76df-493b-893d-087be3e58f6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:22.530482 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-0cdce41c-76df-493b-893d-087be3e58f6d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028233 Jun 23 08:13:22.531049 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 08:13:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:24.651932 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-f6cbe8ac-24cd-43ba-8070-c7893d5b9012 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:24.652939 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-f6cbe8ac-24cd-43ba-8070-c7893d5b9012 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 23 08:13:24.653582 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:24.716522 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-ac9d39c4-cb9d-4f69-a9f5-be54e3c77387 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:24.740431 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-ac9d39c4-cb9d-4f69-a9f5-be54e3c77387 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080808 Jun 23 08:13:24.741527 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 23 08:13:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:13:26.839065 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-f6cbe8ac-24cd-43ba-8070-c7893d5b9012 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:26.840151 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-f6cbe8ac-24cd-43ba-8070-c7893d5b9012 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 23 08:13:26.840550 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:26.902671 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-cad0e736-b52f-48bb-88ed-d0ef2c823428 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:26.924354 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-cad0e736-b52f-48bb-88ed-d0ef2c823428 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077851 Jun 23 08:13:26.925108 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:13:26.940635 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-5d377de1-ab90-4bb1-bbc6-23b51c647aea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:26.970731 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-5d377de1-ab90-4bb1-bbc6-23b51c647aea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034798 Jun 23 08:13:26.971541 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 08:13:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:29.038719 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-cad0e736-b52f-48bb-88ed-d0ef2c823428 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:29.039812 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-cad0e736-b52f-48bb-88ed-d0ef2c823428 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 23 08:13:29.040732 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:29.103729 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-a0811cbd-0dd2-474c-9fcd-1ae1bed6063a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:29.124438 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-a0811cbd-0dd2-474c-9fcd-1ae1bed6063a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078074 Jun 23 08:13:29.124934 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:13:29.137666 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-a9f811f9-1796-47f0-bad0-6d7d67a32d2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:29.162282 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-a9f811f9-1796-47f0-bad0-6d7d67a32d2c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028686 Jun 23 08:13:29.162875 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 08:13:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:13:31.266238 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-a0811cbd-0dd2-474c-9fcd-1ae1bed6063a admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:31.267296 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-a0811cbd-0dd2-474c-9fcd-1ae1bed6063a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 23 08:13:31.267710 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:31.331749 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-32a9acd3-69cc-4ec8-ab16-75b3ce9a36c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "ram": 4096, "name": "m1.medium", "id": "3"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:31.354580 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-32a9acd3-69cc-4ec8-ab16-75b3ce9a36c6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079007 Jun 23 08:13:31.355325 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:13:31.371239 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-85bca963-00f8-49a2-aa38-d04447ea8918 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:31.400500 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-85bca963-00f8-49a2-aa38-d04447ea8918 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034138 Jun 23 08:13:31.401233 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 08:13:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:33.469803 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-32a9acd3-69cc-4ec8-ab16-75b3ce9a36c6 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:33.470818 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-32a9acd3-69cc-4ec8-ab16-75b3ce9a36c6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 23 08:13:33.471235 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:33.538926 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-3525da67-9ada-4dbf-b36b-3182e4d8d1d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:33.558562 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-3525da67-9ada-4dbf-b36b-3182e4d8d1d3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080930 Jun 23 08:13:33.559434 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 08:13:33.571174 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-4b272118-90f0-41c9-8213-a2f65d87471b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:33.594937 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-4b272118-90f0-41c9-8213-a2f65d87471b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027616 Jun 23 08:13:33.595534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 08:13:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:13:35.637705 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-3525da67-9ada-4dbf-b36b-3182e4d8d1d3 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:13:35.638714 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-3525da67-9ada-4dbf-b36b-3182e4d8d1d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 23 08:13:35.639114 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:13:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:13:35.697995 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-17a9cbfb-d8d2-40b9-a374-5d075b34dce1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "id": "5", "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:35.716672 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-17a9cbfb-d8d2-40b9-a374-5d075b34dce1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071362 Jun 23 08:13:35.717336 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 08:13:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 08:13:35.729583 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d1390b9c-62e3-4912-b426-d73a468c1020 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:13:35.754077 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d1390b9c-62e3-4912-b426-d73a468c1020 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028279 Jun 23 08:13:35.754822 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 08:13:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:14:00.330589 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-17a9cbfb-d8d2-40b9-a374-5d075b34dce1 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:00.332011 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-17a9cbfb-d8d2-40b9-a374-5d075b34dce1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 23 08:14:00.332440 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:14:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:00.343480 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:14:00.393743 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-5ef32245-beb9-4069-a61c-5abdf2b1c61c admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:00.410656 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-5ef32245-beb9-4069-a61c-5abdf2b1c61c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071921 Jun 23 08:14:00.411141 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 23 08:14:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:14:01.330233 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-17a9cbfb-d8d2-40b9-a374-5d075b34dce1 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:01.331241 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-17a9cbfb-d8d2-40b9-a374-5d075b34dce1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 23 08:14:01.331943 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:01.526134 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-8b5fc14a-13d2-44c4-a936-8301801fa448 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:01.532043 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.wsgi [None req-8b5fc14a-13d2-44c4-a936-8301801fa448 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-8b5fc14a-13d2-44c4-a936-8301801fa448 admin admin] Request method failure captured: Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Accept: application/json Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Accept-Encoding: gzip, deflate Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Connection: keep-alive Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Content-Length: 0 Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Host: 10.222.0.33 Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Openstack-Api-Version: compute 2.90 Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Openstack-System-Scope: None Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: User-Agent: python-novaclient Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Auth-Token: gAAAAABitCDJOglSQ7_UIGTusBXKTPFqHKcfKSRgiI9h50M8pdpIOG18onVBL3vD3nmU7_-oZnTfahddje3tNpZ8uoXOCqok-DlWEP2SspykNkXR2fXaXWnUJRM8lttWFODHBPlSli0__w9yFFm2fadq-GWB-rr77iIHItxoH_Uw8muuH8c0vuY Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Domain-Id: None Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Domain-Name: None Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Identity-Status: Confirmed Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Is-Admin-Project: True Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Domain-Id: default Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Domain-Name: Default Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Name: admin Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Role: admin,member,reader Jun 23 08:14:01.535424 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Roles: admin,member,reader Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e27258dd6f419b9b00f5d07551d7c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}] Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant: admin Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant-Name: admin Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User: admin Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Domain-Id: default Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Domain-Name: Default Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Id: 76b6ddf40257432aa78fadccd4348cd5 Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Name: admin Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: method: > Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: exception: Flavor 42 could not be found. Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: action_args: {'id': '42'} Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:14:01.537046 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:01.538093 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.539595 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-8b5fc14a-13d2-44c4-a936-8301801fa448 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:14:01.540876 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-8b5fc14a-13d2-44c4-a936-8301801fa448 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069377 Jun 23 08:14:01.540876 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 23 08:14:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 08:14:01.546833 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-6d86420d-3dc1-4b92-a98f-0f1c6aa3f8b5 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:01.549882 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:14:01.569653 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-6d86420d-3dc1-4b92-a98f-0f1c6aa3f8b5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026415 Jun 23 08:14:01.570120 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 08:14:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:14:01.580120 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-a8f4d903-4266-4a53-8952-72cd2276fd41 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:01.601843 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-a8f4d903-4266-4a53-8952-72cd2276fd41 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025337 Jun 23 08:14:01.602386 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 08:14:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:14:01.615376 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-e26464ee-974a-475d-aef4-d3c7e67a5d8f admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:01.621480 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.wsgi [None req-e26464ee-974a-475d-aef4-d3c7e67a5d8f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-e26464ee-974a-475d-aef4-d3c7e67a5d8f admin admin] Request method failure captured: Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Accept: application/json Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Accept-Encoding: gzip, deflate Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Connection: keep-alive Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Content-Length: 0 Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Host: 10.222.0.33 Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Openstack-Api-Version: compute 2.90 Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Openstack-System-Scope: None Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: User-Agent: python-novaclient Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Auth-Token: gAAAAABitCDJOglSQ7_UIGTusBXKTPFqHKcfKSRgiI9h50M8pdpIOG18onVBL3vD3nmU7_-oZnTfahddje3tNpZ8uoXOCqok-DlWEP2SspykNkXR2fXaXWnUJRM8lttWFODHBPlSli0__w9yFFm2fadq-GWB-rr77iIHItxoH_Uw8muuH8c0vuY Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Domain-Id: None Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Domain-Name: None Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Identity-Status: Confirmed Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Is-Admin-Project: True Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Domain-Id: default Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Domain-Name: Default Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Name: admin Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Role: admin,member,reader Jun 23 08:14:01.624804 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Roles: admin,member,reader Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e27258dd6f419b9b00f5d07551d7c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}] Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant: admin Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant-Name: admin Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User: admin Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Domain-Id: default Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Domain-Name: Default Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Id: 76b6ddf40257432aa78fadccd4348cd5 Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Name: admin Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: method: > Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: exception: Flavor 42 could not be found. Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: action_args: {'id': '42'} Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:14:01.626274 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:01.627117 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:01.628384 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-e26464ee-974a-475d-aef4-d3c7e67a5d8f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:14:01.629901 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-e26464ee-974a-475d-aef4-d3c7e67a5d8f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015531 Jun 23 08:14:01.629901 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 23 08:14:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 08:14:02.456000 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-a8f4d903-4266-4a53-8952-72cd2276fd41 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:02.457048 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-a8f4d903-4266-4a53-8952-72cd2276fd41 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 23 08:14:02.457617 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:02.661910 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-ad83638d-a4fc-4433-b673-802e1d8b0e68 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:02.669624 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.wsgi [None req-ad83638d-a4fc-4433-b673-802e1d8b0e68 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-ad83638d-a4fc-4433-b673-802e1d8b0e68 admin admin] Request method failure captured: Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Accept: application/json Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Accept-Encoding: gzip, deflate Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Connection: keep-alive Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Content-Length: 0 Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Host: 10.222.0.33 Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Openstack-Api-Version: compute 2.90 Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Openstack-System-Scope: None Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: User-Agent: python-novaclient Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Auth-Token: gAAAAABitCDKAC1qEF_0QZAYVECPSJwsjBooTSjM1AYoZOpWBKwNo4aeRfYdI6v647qAIpULOX0vQVTp3fqMIruabnDbiIO4dL6xf18ROJkdFZO8ojZqUMmjJkruxB8iSaBA4IcN-urns9fmet9NcobMh5s6EQor9NgKlDThLrT7aQ5S6GcFIEc Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Domain-Id: None Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Domain-Name: None Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Identity-Status: Confirmed Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Is-Admin-Project: True Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Domain-Id: default Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Domain-Name: Default Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Name: admin Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Role: admin,member,reader Jun 23 08:14:02.671119 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Roles: admin,member,reader Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e27258dd6f419b9b00f5d07551d7c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}] Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant: admin Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant-Name: admin Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User: admin Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Domain-Id: default Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Domain-Name: Default Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Id: 76b6ddf40257432aa78fadccd4348cd5 Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Name: admin Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: method: > Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: exception: Flavor 84 could not be found. Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: action_args: {'id': '84'} Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:14:02.672534 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:02.673339 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.674392 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-ad83638d-a4fc-4433-b673-802e1d8b0e68 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:14:02.675538 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-ad83638d-a4fc-4433-b673-802e1d8b0e68 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.080036 Jun 23 08:14:02.675538 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 23 08:14:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 08:14:02.682998 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-3d6fa82a-db38-4ff7-89bc-3c9ca032ac44 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:02.698358 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-3d6fa82a-db38-4ff7-89bc-3c9ca032ac44 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019054 Jun 23 08:14:02.698898 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 08:14:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:14:02.708399 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d9ea7766-c8a2-4249-ae4e-f527ab714385 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:02.722312 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-d9ea7766-c8a2-4249-ae4e-f527ab714385 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017355 Jun 23 08:14:02.722881 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 08:14:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:14:02.734888 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d175aa96-ec72-415e-a8ab-f6127c4ba415 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:02.743611 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.wsgi [None req-d175aa96-ec72-415e-a8ab-f6127c4ba415 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d175aa96-ec72-415e-a8ab-f6127c4ba415 admin admin] Request method failure captured: Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Accept: application/json Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Accept-Encoding: gzip, deflate Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Connection: keep-alive Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Content-Length: 0 Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Host: 10.222.0.33 Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Openstack-Api-Version: compute 2.90 Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Openstack-System-Scope: None Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: User-Agent: python-novaclient Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Auth-Token: gAAAAABitCDKAC1qEF_0QZAYVECPSJwsjBooTSjM1AYoZOpWBKwNo4aeRfYdI6v647qAIpULOX0vQVTp3fqMIruabnDbiIO4dL6xf18ROJkdFZO8ojZqUMmjJkruxB8iSaBA4IcN-urns9fmet9NcobMh5s6EQor9NgKlDThLrT7aQ5S6GcFIEc Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Domain-Id: None Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Domain-Name: None Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Identity-Status: Confirmed Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Is-Admin-Project: True Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Domain-Id: default Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Domain-Name: Default Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Name: admin Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Role: admin,member,reader Jun 23 08:14:02.746087 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Roles: admin,member,reader Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e27258dd6f419b9b00f5d07551d7c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}] Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant: admin Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant-Name: admin Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User: admin Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Domain-Id: default Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Domain-Name: Default Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Id: 76b6ddf40257432aa78fadccd4348cd5 Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Name: admin Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: method: > Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: exception: Flavor 84 could not be found. Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: action_args: {'id': '84'} Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:14:02.747440 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:02.748213 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:02.749409 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d175aa96-ec72-415e-a8ab-f6127c4ba415 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:14:02.750587 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d175aa96-ec72-415e-a8ab-f6127c4ba415 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.018423 Jun 23 08:14:02.750587 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 23 08:14:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 08:14:03.560862 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d9ea7766-c8a2-4249-ae4e-f527ab714385 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:03.561875 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-d9ea7766-c8a2-4249-ae4e-f527ab714385 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 23 08:14:03.562462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:03.760055 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d80a5ff5-4019-42d1-af56-cc0ca2c04562 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:03.765917 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.wsgi [None req-d80a5ff5-4019-42d1-af56-cc0ca2c04562 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d80a5ff5-4019-42d1-af56-cc0ca2c04562 admin admin] Request method failure captured: Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Accept: application/json Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Accept-Encoding: gzip, deflate Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Connection: keep-alive Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Content-Length: 0 Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Host: 10.222.0.33 Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Openstack-Api-Version: compute 2.90 Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Openstack-System-Scope: None Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: User-Agent: python-novaclient Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Auth-Token: gAAAAABitCDLgTKzmrAZ3JFWnoINOJHNK0OrUsn0NB3NGGlDjdHzBkcAUGRpvuzw01f8GzMuAjDu0QnnFejvXEr4BqjqnAQe1jaRbQJ6GOJMjTxiUnqFK_IJUKj5y7-pKLMsBn2ijaAAly5XmiOrkWL56If8VxeNLAjTI_A0iV60telqda--cTs Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Domain-Id: None Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Domain-Name: None Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Identity-Status: Confirmed Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Is-Admin-Project: True Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Domain-Id: default Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Domain-Name: Default Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Project-Name: admin Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Role: admin,member,reader Jun 23 08:14:03.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Roles: admin,member,reader Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e27258dd6f419b9b00f5d07551d7c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}] Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant: admin Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-Tenant-Name: admin Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User: admin Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Domain-Id: default Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Domain-Name: Default Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Id: 76b6ddf40257432aa78fadccd4348cd5 Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: X-User-Name: admin Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: method: > Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: exception: Flavor 451 could not be found. Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: action_args: {'id': '451'} Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:14:03.768966 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:03.770121 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.771415 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d80a5ff5-4019-42d1-af56-cc0ca2c04562 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:14:03.772750 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d80a5ff5-4019-42d1-af56-cc0ca2c04562 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070844 Jun 23 08:14:03.772750 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 08:14:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 08:14:03.778884 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-a4a63842-dcfc-4f1b-80c0-a6322946181f admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:03.792639 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-a4a63842-dcfc-4f1b-80c0-a6322946181f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017519 Jun 23 08:14:03.793272 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 08:14:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:14:03.803028 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:03.818690 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019318 Jun 23 08:14:03.819239 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 08:14:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:14:03.828573 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-5d03ab51-4467-4ad8-bad9-897b0e98b363 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:03.834272 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.wsgi [None req-5d03ab51-4467-4ad8-bad9-897b0e98b363 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-5d03ab51-4467-4ad8-bad9-897b0e98b363 admin admin] Request method failure captured: Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Accept: application/json Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Accept-Encoding: gzip, deflate Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Connection: keep-alive Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Content-Length: 0 Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Host: 10.222.0.33 Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Openstack-Api-Version: compute 2.90 Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Openstack-System-Scope: None Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: User-Agent: python-novaclient Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Auth-Token: gAAAAABitCDLgTKzmrAZ3JFWnoINOJHNK0OrUsn0NB3NGGlDjdHzBkcAUGRpvuzw01f8GzMuAjDu0QnnFejvXEr4BqjqnAQe1jaRbQJ6GOJMjTxiUnqFK_IJUKj5y7-pKLMsBn2ijaAAly5XmiOrkWL56If8VxeNLAjTI_A0iV60telqda--cTs Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Domain-Id: None Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Domain-Name: None Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Identity-Status: Confirmed Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Is-Admin-Project: True Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Domain-Id: default Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Domain-Name: Default Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Project-Name: admin Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Role: admin,member,reader Jun 23 08:14:03.835793 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Roles: admin,member,reader Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44e27258dd6f419b9b00f5d07551d7c9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44e27258dd6f419b9b00f5d07551d7c9"}]}] Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant: admin Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant-Id: 44e27258dd6f419b9b00f5d07551d7c9 Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-Tenant-Name: admin Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User: admin Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Domain-Id: default Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Domain-Name: Default Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Id: 76b6ddf40257432aa78fadccd4348cd5 Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: X-User-Name: admin Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: method: > Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: exception: Flavor 451 could not be found. Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: action_args: {'id': '451'} Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:14:03.837273 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:03.838162 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jun 23 08:14:03.839462 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-5d03ab51-4467-4ad8-bad9-897b0e98b363 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:14:03.840682 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-5d03ab51-4467-4ad8-bad9-897b0e98b363 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012045 Jun 23 08:14:03.840682 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 08:14:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 08:14:04.665799 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:04.666800 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 23 08:14:04.667189 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:04.880303 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-2eaf403e-7457-4d53-92fd-e6236d2ceaea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:14:04.905710 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-2eaf403e-7457-4d53-92fd-e6236d2ceaea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.095560 Jun 23 08:14:04.906271 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 23 08:14:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:14:05.738374 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:05.739829 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001915 Jun 23 08:14:05.740222 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:14:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:05.943292 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-a0bb3102-6ade-4c58-8c6d-9cbe6c92b730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:14:05.965947 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-a0bb3102-6ade-4c58-8c6d-9cbe6c92b730 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087837 Jun 23 08:14:05.966490 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 23 08:14:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:14:06.792623 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:06.793631 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 23 08:14:06.794005 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:06.989840 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-efd33b1a-2a06-4554-a1e5-bf9c0eb5b9e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:14:07.008248 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-efd33b1a-2a06-4554-a1e5-bf9c0eb5b9e6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.074454 Jun 23 08:14:07.008797 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 23 08:14:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:14:07.824866 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:07.825861 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 23 08:14:07.826254 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:08.023475 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-f7317bb7-9a96-4306-923e-2bfb9c5a2bda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:14:08.043441 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-f7317bb7-9a96-4306-923e-2bfb9c5a2bda admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.079254 Jun 23 08:14:08.043911 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 23 08:14:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:14:08.877541 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:08.878573 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 23 08:14:08.879085 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:14:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:09.082884 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-ace99de4-aa6c-409b-a8d1-ff3e00486a7c admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:09.102286 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-ace99de4-aa6c-409b-a8d1-ff3e00486a7c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.086437 Jun 23 08:14:09.102825 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Jun 23 08:14:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:14:55.690301 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:55.691943 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-706a8454-958c-48fb-87c2-75c66dca7576 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002301 Jun 23 08:14:55.692598 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 08:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:14:55.706533 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:14:55.756559 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d3cdd566-f2b8-410e-aaa1-e4e9a07f10c2 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:55.775678 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-d3cdd566-f2b8-410e-aaa1-e4e9a07f10c2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076617 Jun 23 08:14:55.776137 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 23 08:14:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:14:55.798897 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-409d5b9a-c9ca-4e9e-b4e6-c256579e702a admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:55.802433 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_api:SELECT=14 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:14:55.808525 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-409d5b9a-c9ca-4e9e-b4e6-c256579e702a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013290 Jun 23 08:14:55.809056 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jun 23 08:14:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:14:55.820555 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d86e8a54-0041-4ff9-bfbe-99f8ec401be4 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:55.828254 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-d86e8a54-0041-4ff9-bfbe-99f8ec401be4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011306 Jun 23 08:14:55.828758 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jun 23 08:14:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:14:55.840372 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:55.848376 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011890 Jun 23 08:14:55.848899 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jun 23 08:14:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:14:55.860338 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-aabec433-6843-4132-8de7-0aa5a45a1eb0 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:14:55.868657 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-aabec433-6843-4132-8de7-0aa5a45a1eb0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011775 Jun 23 08:14:55.869163 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jun 23 08:14:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:18:10.483315 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:18:10.484328 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 23 08:18:10.484870 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:18:10.623782 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_api:SELECT=6 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:18:10.757786 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-e834fee3-7e03-499f-8b95-36ca86788a5e admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:18:10.759063 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 08:18:10.759063 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: warnings.warn(msg) Jun 23 08:18:10.760398 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-e834fee3-7e03-499f-8b95-36ca86788a5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:18:10.760920 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-e834fee3-7e03-499f-8b95-36ca86788a5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:18:10.761711 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-e834fee3-7e03-499f-8b95-36ca86788a5e admin admin] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:18:10.762157 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-e834fee3-7e03-499f-8b95-36ca86788a5e admin admin] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:18:10.795670 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-e834fee3-7e03-499f-8b95-36ca86788a5e admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.174682 Jun 23 08:18:10.796499 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 08:18:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:18:11.636142 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:18:11.637177 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 23 08:18:11.637575 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:18:11.849525 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-378466c7-1c0e-4984-8a43-6f6a62d00bce admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:18:11.850708 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 08:18:11.850708 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: warnings.warn(msg) Jun 23 08:18:11.851909 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-378466c7-1c0e-4984-8a43-6f6a62d00bce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:18:11.852349 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-378466c7-1c0e-4984-8a43-6f6a62d00bce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:18:11.853122 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-378466c7-1c0e-4984-8a43-6f6a62d00bce admin admin] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:18:11.853542 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-378466c7-1c0e-4984-8a43-6f6a62d00bce admin admin] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:18:11.873535 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-378466c7-1c0e-4984-8a43-6f6a62d00bce admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.089935 Jun 23 08:18:11.874131 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 08:18:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:18:23.143677 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:18:23.144730 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 23 08:18:23.145126 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:18:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:18:23.286987 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_cell0:SELECT=4 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:18:23.287713 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_cell1:SELECT=4 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:18:23.288332 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_api:SELECT=8 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:18:23.339685 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d1ceabc8-3191-4b5b-8943-220eb9fc1f9d admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:18:23.340858 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 08:18:23.340858 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: warnings.warn(msg) Jun 23 08:18:23.342040 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-d1ceabc8-3191-4b5b-8943-220eb9fc1f9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:18:23.342726 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-d1ceabc8-3191-4b5b-8943-220eb9fc1f9d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:18:23.343591 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-d1ceabc8-3191-4b5b-8943-220eb9fc1f9d admin admin] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:18:23.344020 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-d1ceabc8-3191-4b5b-8943-220eb9fc1f9d admin admin] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:18:23.368546 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-d1ceabc8-3191-4b5b-8943-220eb9fc1f9d admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085924 Jun 23 08:18:23.369104 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 08:18:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:18:24.190109 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:18:24.191120 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-7c10ed18-9d8a-4fe9-9082-0f62935c94f4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 23 08:18:24.191550 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 08:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:18:24.409287 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-f3162119-336d-46f9-bdca-d6c3679b3060 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:18:24.410441 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 08:18:24.410441 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: warnings.warn(msg) Jun 23 08:18:24.411651 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-f3162119-336d-46f9-bdca-d6c3679b3060 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:18:24.412082 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-f3162119-336d-46f9-bdca-d6c3679b3060 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:18:24.412848 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-f3162119-336d-46f9-bdca-d6c3679b3060 admin admin] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:18:24.413264 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-f3162119-336d-46f9-bdca-d6c3679b3060 admin admin] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:18:24.434533 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-f3162119-336d-46f9-bdca-d6c3679b3060 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093272 Jun 23 08:18:24.435052 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 08:18:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:19:20.422929 dv-cinder-847216-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 08:19:20.423541 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: Thu Jun 23 08:19:20 2022 - graceful shutdown triggered... Jun 23 08:19:20.424016 dv-cinder-847216-2-iscsi devstack@n-api.service[103245]: Gracefully killing worker 2 (pid: 103245)... Jun 23 08:19:20.424373 dv-cinder-847216-2-iscsi devstack@n-api.service[103244]: Gracefully killing worker 1 (pid: 103244)... Jun 23 08:19:21.424810 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: worker 1 buried after 1 seconds Jun 23 08:19:21.424810 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: worker 2 buried after 1 seconds Jun 23 08:19:21.424810 dv-cinder-847216-2-iscsi devstack@n-api.service[103243]: goodbye to uWSGI. Jun 23 08:19:21.427480 dv-cinder-847216-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 08:19:21.428401 dv-cinder-847216-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 08:19:21.432705 dv-cinder-847216-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 08:19:21.444263 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 08:19:21 2022] *** Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: nodename: dv-cinder-847216-2-iscsi Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: machine: x86_64 Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: clock source: unix Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: pcre jit disabled Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: detected number of CPU cores: 4 Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: current working directory: / Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: detected binary path: /usr/bin/uwsgi-core Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: your processes number limit is 47680 Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: your memory page size is 4096 bytes Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: detected max file descriptor number: 2048 Jun 23 08:19:21.446303 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: lock engine: pthread robust mutexes Jun 23 08:19:21.447171 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: thunder lock: enabled Jun 23 08:19:21.447171 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 08:19:21.447171 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 08:19:21.491449 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: Python main interpreter initialized at 0x55c2f33149c0 Jun 23 08:19:21.491449 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: python threads support enabled Jun 23 08:19:21.491449 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: your server socket listen backlog is limited to 100 connections Jun 23 08:19:21.491449 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: your mercy for graceful operations on workers is 90 seconds Jun 23 08:19:21.491860 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 08:19:21.491860 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: *** Operational MODE: preforking *** Jun 23 08:19:21.491994 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: *** uWSGI is running in multiple interpreter mode *** Jun 23 08:19:21.491994 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: spawned uWSGI master process (pid: 117734) Jun 23 08:19:21.492180 dv-cinder-847216-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 08:19:21.492698 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: spawned uWSGI worker 1 (pid: 117757, cores: 1) Jun 23 08:19:21.493232 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: spawned uWSGI worker 2 (pid: 117758, cores: 1) Jun 23 08:19:21.493545 dv-cinder-847216-2-iscsi devstack@n-api.service[117734]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 08:19:22.158321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 08:19:22.161442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 08:19:23.354115 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:19:23.354115 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: from cryptography.utils import int_from_bytes Jun 23 08:19:23.354828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:19:23.354828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: from cryptography.utils import int_from_bytes Jun 23 08:19:23.389059 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:19:23.389059 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: from cryptography.utils import int_from_bytes Jun 23 08:19:23.389698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:19:23.389698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: from cryptography.utils import int_from_bytes Jun 23 08:19:25.758981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 08:19:25.759963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 08:19:25.760703 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 08:19:25.761055 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 08:19:25.761312 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 08:19:25.761742 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.762074 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.762398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.762720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.763049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.763349 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.763677 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.764049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.764352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.764592 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.764998 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.765352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847216-2-iscsi {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.765673 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.766161 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.766477 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.766791 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.767096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.767445 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.767755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.768254 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.769851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.769851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.769851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.769851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.770221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.770221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.770528 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.770825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.771149 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.771524 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.771907 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847216-2-iscsi {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.772225 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.772538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.772851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.773279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.773608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.773905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.774215 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.774536 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.774866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.775169 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.775542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.775843 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.776171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.776473 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.776784 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.777091 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.777410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.777713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.778039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.778262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.778551 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.779099 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.779440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.779773 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.780039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.780489 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.781174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.781640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.781951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.782279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.782604 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.782900 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.783184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.783547 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.783837 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.784159 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.784477 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.784797 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.785120 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.785426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.785734 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.786159 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.786426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.786728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.787064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.787416 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.787727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.788046 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.788384 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.788688 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.788996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.789304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.789621 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.789942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.790245 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.790493 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.790795 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.791104 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.791451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.791745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.792062 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.792368 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.792681 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.792970 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.793291 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.793581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.794007 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.794205 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.794504 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.794794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.795118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.795448 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.795773 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.796226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.796776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.797085 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.797401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.797710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.798211 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.798521 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.798829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.799163 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.799499 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.799806 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.800122 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.800427 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.800736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.801054 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.801347 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.801682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.801971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.802265 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.802556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.802873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.803175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.803563 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.803807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.804101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.804406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.804689 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.805041 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.805373 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.805682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.805988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.806326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.806619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.807046 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.807378 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.807723 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.808039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.808369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.808698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.809013 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.809323 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.809637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.809963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.810272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.810580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.810890 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.811257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.811640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.811976 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.812422 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.812657 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.812943 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.813252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.813569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.813900 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.814218 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.814523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.814865 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.815235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.815553 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.815873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.816197 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.816508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.816814 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.817261 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.817429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.817767 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.818138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.818391 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.818701 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.819011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.819354 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.819666 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.819974 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.820316 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.820632 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.820945 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.821255 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.821570 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.821878 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.822186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.822559 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.822796 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.823101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.823428 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.823735 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.824041 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.824359 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.824686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.824993 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.825331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.825687 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.825942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.826252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.826569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.826860 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.827491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.827706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.827925 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.828274 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.828557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.828864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.829187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.829495 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.829800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.830116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.830426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.830736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.831045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.831382 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.832326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.832326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.832326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.832877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.833031 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.833310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.833555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.833875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.834195 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.834493 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.834855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.835160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.835497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.835835 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.836105 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.836406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.836710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.837012 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.837319 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.837750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.837937 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.838246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.838549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.838849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.839151 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.839523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.839829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.840169 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.840504 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.840823 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.841144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.841455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.841767 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.842523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.842523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.842869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.843262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.843570 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.843730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.843981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.844300 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.844608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.844914 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.845234 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.845779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.846046 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.846203 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.846359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 08:19:25.846846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 08:19:25.846998 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.846998 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.847471 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 08:19:25.847624 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.848023 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 08:19:25.848193 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.848354 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 08:19:25.848450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.848552 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.848716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.848812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.848905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.848990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.849071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.849165 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.849265 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.849357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.849447 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.849567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.849692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.849880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.849997 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.850189 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.850308 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.850514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.850638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.850969 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.851075 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.851326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.851500 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.851658 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847216-2-iscsi {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.851800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.851983 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.852083 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.852294 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.852422 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.852606 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.852698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.852923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.853015 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.853235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.853328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.853569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.853767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.853951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.854143 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.854329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.854485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.854664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.854822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.854992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.855149 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.855352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.855543 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.855718 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.856096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.856370 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.856624 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.856870 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.857124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.857381 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.857381 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.857874 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.858129 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.858848 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.859112 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.859401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.859665 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.860113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.860382 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.860631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847216-2-iscsi {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.860792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.860951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.861137 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.861321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.861573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.861573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.861972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.862131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.862131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.862423 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.862571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.862728 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.862872 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.863025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.863171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.863171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.863527 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.863675 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.863819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.863978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.864130 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.864282 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.864428 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.864591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.864591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.864884 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.865038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.865191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.865344 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.865497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.865651 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.865797 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.865949 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.866103 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.866247 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.866407 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.866572 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.866725 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.866869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.867022 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.867168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.867448 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.867448 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.867741 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.867893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.868037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.868189 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.868344 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.868508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.868664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.868664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.868945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.868945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.869231 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.869385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.869539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.869695 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.869848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.870026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.870176 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.870331 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.870475 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.870625 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.870771 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.870928 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.871093 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.871261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.871261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.871561 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.871707 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.871864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.872010 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.872161 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.872325 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.872471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.872622 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.872781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.872934 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.873390 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.873545 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.873698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.873862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.874055 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.874208 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.874360 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.874517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.874675 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.874829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.875045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.876481 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.876653 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.876816 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.876965 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.877119 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.877272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.877431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.877645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.877793 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.877971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.878128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.878275 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.878426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.878426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.878711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.878711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.878994 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.879137 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.879316 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.879478 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.879641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.879789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.879945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.880097 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.880243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.880415 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.880561 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.880718 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.880872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.881017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.881161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.881313 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.881474 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.881629 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.881783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.881783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.882085 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.882230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.882384 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.882529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.882680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.882834 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.882988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.883141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.883371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.883519 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.883663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.883807 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.883974 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.884127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.884274 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.884425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.884578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.884723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.884881 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.885036 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.885181 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.885325 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.885478 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.885638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.885794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.885937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.886083 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.886226 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.886377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.886535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.886681 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.886827 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.886982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.886982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.887276 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.887426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.887580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.887736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.887894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.888040 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.888193 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.888344 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.888489 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.888633 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.888785 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.888937 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.889082 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.889226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.889369 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.889528 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.889762 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.890005 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.890225 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.890398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.890587 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.890755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.890911 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.891068 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.891296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.891460 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.891615 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.891776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.891923 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.892087 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.892240 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.892388 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.892533 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.892686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.892831 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.892983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.893136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.893289 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.893450 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.893596 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.893749 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.893905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.893905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.893905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.894326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.894481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.894626 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.894779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.894932 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.895077 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.895254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.895408 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.895564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.895709 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.895875 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.896029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.896029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.896315 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:19:25.896468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.896623 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.896768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.896921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.897067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.897211 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.897362 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.897516 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.897670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.897839 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.897987 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.898139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.898284 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.898428 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.898573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.898728 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.898874 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.899019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.899162 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.899351 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.899502 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.899674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.899830 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.899976 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.900119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.900263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.900415 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.900567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.900722 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.900874 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.901021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.901021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.901311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.901456 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.901616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.901807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.901966 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.902119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.902275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.902275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.902566 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.902718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.902873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.902873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.903164 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.903331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.903476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.903630 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.903787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.903942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.904089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.904240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.904395 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.904547 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.904700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.904844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.904959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905146 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905448 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905711 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905796 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.905951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906127 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906215 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906305 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906391 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906853 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.906946 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907133 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907362 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907436 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907667 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.907942 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908183 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908262 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908334 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908404 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908472 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908550 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908622 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908715 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.908969 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909052 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909210 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909286 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909392 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909485 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909559 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909636 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.909808 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.910327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.910440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.910605 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.910712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.910855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.910948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.911112 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.911112 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.911304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.911436 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.911529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.911748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.911897 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.912054 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.912188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.912363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.912494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.912670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.912811 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.912985 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.913124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.913292 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.913439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.913595 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.913739 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.913917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.914050 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.914230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.914372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.914557 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.914699 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.914867 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.915000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.915175 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.915342 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.915492 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.915639 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.915803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.915952 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.916115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.916246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.916423 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.916565 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.916802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.916937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.917076 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.917209 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.917368 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.917665 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.917799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.917939 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.918071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.918211 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.918343 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.918481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.918621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.918755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.918984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.919134 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.919304 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.919456 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.919648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.919956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.920128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.920272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.920447 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.920591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.920761 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.920930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.921311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.921552 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.921689 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.921881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.922024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.922196 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.922345 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.922512 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.922654 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.922828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.922970 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.923139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.923334 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.923476 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.923609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.923785 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.923925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.924093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.924235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.924407 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.924549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.924718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.924853 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.925028 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.925177 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.925336 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.925470 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.925643 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.925784 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.925990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.926125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.926300 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.926432 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.926634 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.926788 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.926974 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.927117 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.927268 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.927414 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.927568 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.927830 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.927978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.928111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.928241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.928379 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.928512 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.928652 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.928792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.928924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.929084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.929217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.929355 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.929502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.929642 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.929782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.929921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.930056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.930728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.930884 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.931019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.931151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.931311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.931446 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.931576 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.931716 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.931855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.932002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.932136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.932275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.932415 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.932557 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.932689 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.932830 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.932962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.933099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.933254 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.933396 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.933535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.933675 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.933807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.933946 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.934162 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.934299 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.934429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.934560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.934690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.934828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.934974 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.935107 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.935292 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.935437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.935569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.935708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.935854 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.935995 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.936136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.936284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.936426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.936635 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.936779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.936989 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.937250 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.937386 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.937576 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.937724 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.938010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.938142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.938272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.938410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.938551 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.938692 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.938823 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.938960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.939091 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.939241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.939374 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.939523 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.939664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.939795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.939932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.940071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.940246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.940381 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.940551 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.940684 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.940874 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.941006 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.941215 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.941349 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.941493 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.941638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.941777 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.941908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.942045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.942177 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.942378 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.942516 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.942683 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.942790 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.943014 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.943118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.943358 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.943458 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.943683 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.943787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.943986 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.944083 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.944291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.944388 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.944606 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.944707 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.944921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.945012 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.945233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.945321 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.945544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.945643 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.945859 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.945971 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.946166 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.946266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.946471 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.946580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.946782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.946872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.947092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.947202 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.947423 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.947520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.947732 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.947840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.948041 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.948142 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.948383 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.948584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.948684 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.948917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.949008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.949239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.949363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.949557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.949661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.949869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.949961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.950185 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.950288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.950496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.950593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.950807 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.950924 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.951114 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.951227 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.951449 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.951549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.951757 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.951858 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.952071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.952164 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.952433 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.952759 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.952960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.953196 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.953333 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.953517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.953612 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.953835 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.953925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.954153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.954246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.954467 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.954557 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.954797 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.954892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.955106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.955199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.955446 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.955547 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.955762 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.955864 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.956077 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.956333 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.956442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.956669 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.956761 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.956980 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.957088 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.957294 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.957409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.957607 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.957720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.957913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.958072 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.958228 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.958407 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.958573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.958724 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.958883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.959032 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.959186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.959389 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.959539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.959686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.959830 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.959984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.960210 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.960385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.960535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.960701 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.960701 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.960985 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.961181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.961346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.961495 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.961640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.961797 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.961944 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.962091 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.962244 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.962391 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.962548 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.962777 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.962944 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.963100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.963314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.963478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.963478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.963764 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.963909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.964066 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.964227 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.964377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.964377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.964663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.964817 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.964973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.965119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.965264 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.965264 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.965556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.965718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.965871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.965871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.966145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.966145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.966442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.966442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.966748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.966748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.967023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.967176 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.967381 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.967535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.967681 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.967884 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.968066 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.968305 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.968497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.968663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.968810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.968955 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.969108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.969262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.969409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.969553 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.969697 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.969849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.970002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.970236 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.970385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.970530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.970696 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.970842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.970994 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.971154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.971330 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.971488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.971644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.971798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.971953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.972100 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.972244 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.972387 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.972539 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.972698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.972943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.973096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.973252 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.973398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.973550 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.973705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.973860 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.974008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.974153 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.974316 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.974471 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.974616 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.974784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.974939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.975086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.975249 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.975411 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.975571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.975718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.975862 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.976005 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.976157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.976303 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.976461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.976608 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.976770 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.976917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.977067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.977214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.977367 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.977513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.977666 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.977812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.977964 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.978110 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.978268 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.978423 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.978586 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.978733 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.978879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.979038 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.979193 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.979376 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.979521 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.979677 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.979825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.979983 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.980138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.980291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.980446 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.980609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.980755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.980909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.981054 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.981199 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.981199 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.981480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.981626 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.981786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.981942 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.982095 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.982251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.982397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.982565 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.982721 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.982875 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.983116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.983296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.983478 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.983635 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.983781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.983969 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.984264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.984424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.984578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.984735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.984893 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.985046 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.985200 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.985354 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.985500 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.985661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.985815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.985961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.986107 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.986251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.986406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.986554 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.986709 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.986853 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.986997 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.987151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.987378 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.987534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.987682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.987835 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.987981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.988132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.988286 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.988440 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.988594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.988752 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.988905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.989061 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.989207 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.989351 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.989495 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.989639 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.989791 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.989947 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.990093 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.990238 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.990382 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.990527 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.990681 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.990902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.991050 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.991195 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.991363 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.991508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.991672 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.991829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.991976 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.992122 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.992266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.992418 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.992584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.992732 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.992883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.993040 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.993277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.993436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.993597 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.993744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.993888 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.994036 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.994180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.994335 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.994491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.994648 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.994801 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.994948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.995094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.995302 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.995455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.995601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.995746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.995901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.995901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.996187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.996334 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.996490 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.996636 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.996788 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.996934 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.997089 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.997237 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.997384 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.997537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.997691 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.997691 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.997983 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.998456 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.998610 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.998776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.998924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.999147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.999476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.999631 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.999778 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.999923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:25.999923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.000216 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.000373 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.000528 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.000674 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.000839 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.000987 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.001146 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.001293 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.001446 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.001591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.001591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.001901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.002064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.002221 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.002368 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.002513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.002665 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.002836 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.002991 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.003139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.003363 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.003515 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.003670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.003670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.003957 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.004102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.004256 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.004421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.004571 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.004732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.004890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.005041 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.005198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.005351 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.005507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.005668 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.005815 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.005961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.006114 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.006260 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.006419 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.006575 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.006729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.006888 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.007041 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.007195 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.007388 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.007537 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.007684 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.007837 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.007984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.008137 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.008292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.008447 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.008601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.008766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.008913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.009110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.009281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.009430 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.009430 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.009714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.009859 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.010013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.010165 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.010326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.010480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.010627 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.010783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.010943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.011097 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.011303 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.011463 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.011618 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.011766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.011927 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.012074 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.012228 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.012375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.012520 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.012677 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.012845 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.013006 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.013154 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.013306 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.013452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.013607 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.013753 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.013898 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.014049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.014203 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.014360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.014545 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.014729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.014883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.015040 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.015186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.015360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.015523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.015523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.015523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.015947 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.016094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.016252 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.016400 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.016553 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.016713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.016859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.017004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.017159 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.017314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.017468 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.017625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.017772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.017917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.018077 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.018231 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.018383 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.018545 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.018705 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.018866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.019033 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.019187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 08:19:26.019384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.019384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.019683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.019917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.020144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.020470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.020795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.021105 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.021430 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.021742 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.022050 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.022358 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.022665 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.023011 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.023350 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.023674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.024006 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.024339 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.024655 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.024993 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.025323 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.025643 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.025963 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.026291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.026601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.026909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.027246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.027559 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.027867 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.028173 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.028483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.028791 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.029098 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.029404 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.029730 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.030040 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.030545 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.031151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.031493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.031806 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.032118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.032467 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.032781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.033120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.033445 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.033774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.034109 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.034427 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.034756 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.035077 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.035421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.035741 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.036060 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.036379 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.036697 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.037016 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.037329 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.037647 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.037972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.038296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.038834 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.039168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.039512 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.039830 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.040151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.040468 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.040785 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.041100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.041418 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.041740 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.042057 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.042387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.042727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.043063 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.043432 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.043754 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.044075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.044393 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.044715 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.045079 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.045398 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.045713 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.046246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.046870 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.047190 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.047566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.047882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.048207 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.048499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.048839 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.049153 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.049444 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.049795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.050122 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.050445 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.050763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.051082 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.051427 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.051743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.052264 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.052571 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.052921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.053245 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.053573 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.053909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.054212 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.054540 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.054851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.055140 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.055479 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.055792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.056100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.056428 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.056740 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.057047 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.057366 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.057682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.058215 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.058567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.058887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.059237 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.059570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.059893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.060201 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.060527 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.060837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.061145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.061483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.062659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.062975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.063322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.063642 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.063951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.064269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.064575 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.064905 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.065215 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.065526 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.065833 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.066147 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.066455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.066764 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.067072 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.067404 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.067725 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.068039 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.068354 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.068665 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.068979 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.069289 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.069600 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.069957 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.070287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.070598 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.070908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.071244 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.071564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.071891 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.072208 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.072522 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.072871 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.073191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.073724 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.074062 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.074382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.074717 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.075048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.075382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.075696 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.076002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.076327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.076641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.076956 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.077452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.078073 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.078390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.078707 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.079023 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.079362 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.079678 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.079990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.080133 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO dbcounter [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Registered counter for database nova_api Jun 23 08:19:26.080302 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.080613 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.080925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.081243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.081590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.081913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.082235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.082554 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.082874 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.083188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.083522 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.083837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.084150 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.084468 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.084800 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.085117 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.085424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.085935 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.086256 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.086581 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.086906 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.087236 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.087567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.087902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.088219 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.088546 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.088861 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.089194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.089534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.089863 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.090189 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.090499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.090804 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.091111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.091450 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.091771 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.092083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.092385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.092692 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.093589 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.093904 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.094215 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.094524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.094833 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.095144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.095670 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.095891 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.096215 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.096508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.096814 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.097120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.097434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.097741 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.098047 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.098357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.098663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.098971 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.099337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.099674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.099999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.100323 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.100591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_db.sqlalchemy.engines [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:19:26.100712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.100945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.101254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.101574 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.101896 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.102217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.102529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.102867 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.103180 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.103515 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.103827 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.104150 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.104455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.104769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.105124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.105452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.105761 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.106087 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.106425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.106727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.107044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.107382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.107481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writer thread running {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:19:26.107715 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.108034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.108397 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.109260 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.109585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.109906 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.110229 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.110551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.110880 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.111238 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.111549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.111880 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.112209 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.112561 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.112877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.113225 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.113558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.113877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.114193 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.114502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:19:26.114748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 08:19:26.164772 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.context [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57905a20-3dbc-4820-af6f-859fc1a10707(cell1) {{(pid=117758) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 08:19:26.169032 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:19:26.170661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:19:26.171545 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:19:26.173501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:19:26.175537 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO dbcounter [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Registered counter for database nova_cell0 Jun 23 08:19:26.178665 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO dbcounter [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Registered counter for database nova_api Jun 23 08:19:26.179520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO dbcounter [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Registered counter for database nova_cell1 Jun 23 08:19:26.186498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_db.sqlalchemy.engines [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:19:26.188939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_db.sqlalchemy.engines [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:19:26.193162 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writer thread running {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:19:26.200026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_db.sqlalchemy.engines [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:19:26.207705 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writer thread running {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:19:26.264849 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.context [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57905a20-3dbc-4820-af6f-859fc1a10707(cell1) {{(pid=117757) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 08:19:26.269573 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:19:26.271199 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:19:26.272013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:19:26.274009 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:19:26.276057 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO dbcounter [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Registered counter for database nova_cell0 Jun 23 08:19:26.280153 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO dbcounter [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Registered counter for database nova_cell1 Jun 23 08:19:26.288485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_db.sqlalchemy.engines [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:19:26.289803 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_db.sqlalchemy.engines [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:19:26.295719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writer thread running {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:19:26.332871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writer thread running {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:19:26.342680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO dbcounter [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Registered counter for database nova_cell0 Jun 23 08:19:26.350166 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_db.sqlalchemy.engines [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:19:26.354904 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writer thread running {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:19:26.443747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writer thread running {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:19:26.453914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO dbcounter [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Registered counter for database nova_cell0 Jun 23 08:19:26.461013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_db.sqlalchemy.engines [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:19:26.466060 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writer thread running {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:19:26.668308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: WARNING keystonemiddleware.auth_token [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 08:19:26.676233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: WARNING keystonemiddleware.auth_token [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 08:19:26.797909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: WARNING keystonemiddleware.auth_token [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 08:19:26.805784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: WARNING keystonemiddleware.auth_token [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 08:19:27.020847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: WARNING keystonemiddleware.auth_token [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 08:19:27.027766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: WARNING keystonemiddleware.auth_token [None req-32a862cc-f370-4c69-92a8-389233ad75d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 08:19:27.033778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2f33149c0 pid: 117758 (default app) Jun 23 08:19:27.161606 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: WARNING keystonemiddleware.auth_token [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 08:19:27.167682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: WARNING keystonemiddleware.auth_token [None req-53d7beb9-ef80-4d83-9a09-2dd9965127b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 08:19:27.173577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2f33149c0 pid: 117757 (default app) Jun 23 08:20:07.377216 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=3 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:07.377216 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=3 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:07.377216 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=3 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:07.377216 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=3 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:09.165227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2daa0433-02e7-4638-8cf6-45551324a7a6 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Action: 'create', calling method: .version_select at 0x7feb69047700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2055316345"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:11.270391 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2daa0433-02e7-4638-8cf6-45551324a7a6 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.992066 Jun 23 08:20:11.278722 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1154 bytes} [Thu Jun 23 08:20:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4001 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 08:20:11.285455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:11.286807 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:11.287621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:11.288914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:11.869914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cb56c776-1c3c-496d-90c8-67e2247669d3 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb69093280>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:12.531149 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cb56c776-1c3c-496d-90c8-67e2247669d3 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e" status: 200 len: 345 microversion: 2.1 time: 1.251356 Jun 23 08:20:12.537599 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 1/2] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:20:11 2022] GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e => generated 345 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:13.545118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6f11c960-6dd9-47de-97ec-c61259220382 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68f0e550>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:13.786968 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6f11c960-6dd9-47de-97ec-c61259220382 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e" status: 200 len: 346 microversion: 2.1 time: 0.245931 Jun 23 08:20:13.794555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:20:13 2022] GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e => generated 346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:13.801793 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cd2c9e69-b4d3-461e-8507-103efa610eae tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Action: 'create', calling method: .version_select at 0x7feb68f574c0>, body: {"snapshot": {"volume_id": "4196f237-c682-45ae-8cfd-576fcfa0f52e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-13456144"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:14.500501 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cd2c9e69-b4d3-461e-8507-103efa610eae tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.704483 Jun 23 08:20:14.502105 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 2/4] 10.222.0.33 () {60 vars in 1161 bytes} [Thu Jun 23 08:20:13 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:20:14.512166 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9394fc51-25b3-4c9d-a1a4-0f15623ac06c tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68f0e8b0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:14.579169 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9394fc51-25b3-4c9d-a1a4-0f15623ac06c tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.070883 Jun 23 08:20:14.580363 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:14 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:14.592524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cd3573bf-1307-41d7-964d-6992b0028baa tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68f57ca0>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:14.687741 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cd3573bf-1307-41d7-964d-6992b0028baa tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.101370 Jun 23 08:20:14.688496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1139 bytes} [Thu Jun 23 08:20:14 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:14.700849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a06b7fca-808a-4e9e-8a63-eb88f1da01a6 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68f0ed30>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:14.748006 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a06b7fca-808a-4e9e-8a63-eb88f1da01a6 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.052986 Jun 23 08:20:14.749083 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:14 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:15.764054 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a5fde2fb-04ec-4018-9434-a0af158510b7 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68f1f1f0>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:15.849524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a5fde2fb-04ec-4018-9434-a0af158510b7 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.091961 Jun 23 08:20:15.850734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:15 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:16.864514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ea123753-705c-4baf-81f7-377cc9cb9da2 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68ea5430>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:16.913543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ea123753-705c-4baf-81f7-377cc9cb9da2 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.055205 Jun 23 08:20:16.914452 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:16 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:17.558712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dbec3b9d-45ac-49a0-81e5-05b6f4867eb1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'create', calling method: .version_select at 0x7feb68f57af0>, body: {"keypair": {"name": "tempest-keypair-1768616518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7ln6G8SwCmkqonpxKHPOJ2yStMSXWoxf1LiRAK0kNVz6nZbCE/03sn8FOEJ7hQINdgsL7H3MSeupwQzHUZ6F+g3O9CBGD9V0eSBCRGMOwNj9R/CVWW0VWDFckXjUZlYQ=="}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:17.678121 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-dbec3b9d-45ac-49a0-81e5-05b6f4867eb1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Getting quotas for project 89774ed6e4964866bf6fd73e32dee267. Resources: {'key_pairs'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:20:17.700267 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-dbec3b9d-45ac-49a0-81e5-05b6f4867eb1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Getting quotas for user 9b178568bc5e4876bdab388ac3302f0a and project 89774ed6e4964866bf6fd73e32dee267. Resources: {'key_pairs'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:20:17.802758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dbec3b9d-45ac-49a0-81e5-05b6f4867eb1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.577276 Jun 23 08:20:17.803809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 5/10] 10.222.0.33 () {62 vars in 1199 bytes} [Thu Jun 23 08:20:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 580 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 23 08:20:17.928335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cf291987-18e4-4fc1-ae17-f11d0c829498 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68f0ed30>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:17.994630 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cf291987-18e4-4fc1-ae17-f11d0c829498 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.073130 Jun 23 08:20:17.995591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:17 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:20:19.006653 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6a2a74cf-6798-4015-a400-bec6dc1ceca2 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68f0e8b0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:19.072535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6a2a74cf-6798-4015-a400-bec6dc1ceca2 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.068739 Jun 23 08:20:19.073407 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 7/12] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:19 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:20:19.548826 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-614421100", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:19.840202 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] validate_networks() for [('e9eb3d75-18c6-4965-8c86-82c4fd973741', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:20:20.086378 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-83663025-38cf-42de-9c43-40788c154786 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68ea5670>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:20.161071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-83663025-38cf-42de-9c43-40788c154786 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.080388 Jun 23 08:20:20.161648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 8/13] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:20 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:21.185286 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0136aaf1-570c-4738-89cd-f5037e6fd237 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68ea5b80>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:21.298234 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0136aaf1-570c-4738-89cd-f5037e6fd237 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.129727 Jun 23 08:20:21.299399 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 9/14] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:21 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:22.031588 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:20:22.032140 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:20:22.032593 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:20:22.033082 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:20:22.033508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:20:22.078925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:22.079933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:22.081727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:22.082822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:22.128087 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Getting quotas for project d08f2f4ac6d54f7484711b28f48aeeb3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:20:22.133272 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Getting quotas for user a15a0abc2f25410b8476464d7cd32802 and project d08f2f4ac6d54f7484711b28f48aeeb3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:20:22.155413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:20:22.159576 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:20:22.290031 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f9bc3fb4-5638-4587-abfd-fb61b559fe95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.444768 Jun 23 08:20:22.290774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 6/15] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:20:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:20:22.302878 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-86571335-7d80-4235-90f0-4aeab615254a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:22.304881 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-86571335-7d80-4235-90f0-4aeab615254a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:22.317113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-669fd660-629c-4dcb-8bf9-702b3f94c378 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb685c5940>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:22.467980 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-669fd660-629c-4dcb-8bf9-702b3f94c378 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.160508 Jun 23 08:20:22.470635 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 7/16] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:22 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:22.701071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-86571335-7d80-4235-90f0-4aeab615254a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:22.749277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-86571335-7d80-4235-90f0-4aeab615254a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1221 microversion: 2.1 time: 0.451280 Jun 23 08:20:22.780473 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 10/17] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:22 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1221 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:23.044662 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-814123433", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:23.162964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] validate_networks() for [('e9eb3d75-18c6-4965-8c86-82c4fd973741', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:20:23.483297 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-87715f51-e784-423b-a6cf-2c1d8a8d6a77 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68ee29d0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:23.584839 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-87715f51-e784-423b-a6cf-2c1d8a8d6a77 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.106833 Jun 23 08:20:23.585709 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 11/18] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:23 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:24.086148 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b8868475-427b-4394-9485-8cf6f243aa9c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: .version_select at 0x7feb68e6b310>, body: {"keypair": {"name": "tempest-keypair-386311704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZgqjiePiU77kwZkdAhE+ynuQ+PCYzfVra6nvwOnLX4zvq6/O8M87itNXmiNvtLbpwM4P+7pj2MAHu89+oJjnjQ7RIF9cVemP+6DiIuaiJrNATJ04S9F57isykUH8WGXA=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:24.225193 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-b8868475-427b-4394-9485-8cf6f243aa9c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for project 4979d926d8894e3db358f16bd6bf7621. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:20:24.242455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-b8868475-427b-4394-9485-8cf6f243aa9c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for user 938efacddf794fd18cd323043906b6c1 and project 4979d926d8894e3db358f16bd6bf7621. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:20:24.365557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b8868475-427b-4394-9485-8cf6f243aa9c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.517422 Jun 23 08:20:24.368686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 12/19] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:20:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:24.605026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ea126798-bef5-4fca-b3fc-4a315157177a tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68e55700>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:24.613689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:20:24.614267 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:20:24.614892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:20:24.615537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:20:24.616159 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:20:24.648842 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:24.648842 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:24.664048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:24.668076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:24.674659 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ea126798-bef5-4fca-b3fc-4a315157177a tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.076723 Jun 23 08:20:24.679907 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 13/20] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:24 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:20:24.723164 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Getting quotas for project d08f2f4ac6d54f7484711b28f48aeeb3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:20:24.733836 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Getting quotas for user a15a0abc2f25410b8476464d7cd32802 and project d08f2f4ac6d54f7484711b28f48aeeb3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:20:24.765368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:20:24.773628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:20:24.877295 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-501487a8-68f8-4c01-8b3c-0e07829980ec tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.838535 Jun 23 08:20:24.881420 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 8/21] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:20:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:20:24.895807 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1786c708-ae6c-4ec4-92d4-623ddfa5f325 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:24.896835 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1786c708-ae6c-4ec4-92d4-623ddfa5f325 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:24.900288 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-166190427", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "831e0759-bd7c-494f-b76a-2b0a2318a2e7"}], "security_groups": [{"name": "tempest-securitygroup--962028730"}], "key_name": "tempest-keypair-1768616518", "user_data": "}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:25.074879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1786c708-ae6c-4ec4-92d4-623ddfa5f325 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:25.107628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1786c708-ae6c-4ec4-92d4-623ddfa5f325 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1221 microversion: 2.1 time: 0.218879 Jun 23 08:20:25.110267 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 9/22] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:24 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1221 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:25.621995 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.network.neutron [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] validate_networks() for [('831e0759-bd7c-494f-b76a-2b0a2318a2e7', None, None, None, None, None)] {{(pid=117758) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:20:25.691936 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c8f40118-c9bd-4c34-a563-85be13303124 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb685c5670>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:25.778439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c8f40118-c9bd-4c34-a563-85be13303124 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 286 microversion: 2.1 time: 0.095125 Jun 23 08:20:25.779188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 10/23] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:25 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:20:25.790937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c4c0244e-aa40-4186-9e4e-7d17aabbebe4 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb6857dc10>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:25.996496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c4c0244e-aa40-4186-9e4e-7d17aabbebe4 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 202 len: 0 microversion: 2.1 time: 0.210555 Jun 23 08:20:25.997365 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1253 bytes} [Thu Jun 23 08:20:25 2022] DELETE /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:20:26.010111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b8173ef7-4957-4e69-9b81-e0f5a917d52a tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb6857db80>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:26.094872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b8173ef7-4957-4e69-9b81-e0f5a917d52a tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.091510 Jun 23 08:20:26.096126 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:26 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:26.132228 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-60e31353-fc50-42ad-a1e3-cd962371b5b0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:26.132841 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-60e31353-fc50-42ad-a1e3-cd962371b5b0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:26.336329 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-60e31353-fc50-42ad-a1e3-cd962371b5b0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:26.352398 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-60e31353-fc50-42ad-a1e3-cd962371b5b0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1221 microversion: 2.1 time: 0.222895 Jun 23 08:20:26.356591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 13/26] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:26 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1221 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:27.374477 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Flavor limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:20:27.376720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Image limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:20:27.384640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Flavor pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:20:27.385661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Image pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:20:27.386555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:20:27.417962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:27.429584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:27.432981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:27.436386 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:27.593967 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Getting quotas for project 89774ed6e4964866bf6fd73e32dee267. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:20:27.621345 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Getting quotas for user 9b178568bc5e4876bdab388ac3302f0a and project 89774ed6e4964866bf6fd73e32dee267. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:20:27.698626 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Going to run 1 instances... {{(pid=117758) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:20:27.718800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:20:27.726433 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1971904785", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "networks": [{"uuid": "848f40cd-736c-4e4a-843e-24706af9c334"}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:27.892881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] validate_networks() for [('848f40cd-736c-4e4a-843e-24706af9c334', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:20:28.086757 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e596a0c7-b044-4fa6-a310-df19309f8910 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.240314 Jun 23 08:20:28.088312 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 14/27] 10.222.0.33 () {62 vars in 1187 bytes} [Thu Jun 23 08:20:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 3243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 08:20:28.108531 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-29d017e3-6b83-4192-a3f8-9830f78a57a5 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb6856db80>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:28.169859 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-29d017e3-6b83-4192-a3f8-9830f78a57a5 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.077039 Jun 23 08:20:28.172926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 15/28] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:28 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:28.218508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-18bf6a0f-7e8e-4abd-9187-ea6bfdc9f15a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:28.221641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-18bf6a0f-7e8e-4abd-9187-ea6bfdc9f15a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:28.278486 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-18bf6a0f-7e8e-4abd-9187-ea6bfdc9f15a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:28.279918 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-18bf6a0f-7e8e-4abd-9187-ea6bfdc9f15a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:28.295737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-18bf6a0f-7e8e-4abd-9187-ea6bfdc9f15a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:28.297538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-18bf6a0f-7e8e-4abd-9187-ea6bfdc9f15a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:28.790754 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-18bf6a0f-7e8e-4abd-9187-ea6bfdc9f15a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:28.853972 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-18bf6a0f-7e8e-4abd-9187-ea6bfdc9f15a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1225 microversion: 2.1 time: 0.675172 Jun 23 08:20:28.857720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 16/29] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:28 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1225 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:28.891626 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f44ab965-b509-49ab-9905-621a7687f161 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:28.892653 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f44ab965-b509-49ab-9905-621a7687f161 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:29.118179 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f44ab965-b509-49ab-9905-621a7687f161 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:29.131892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f44ab965-b509-49ab-9905-621a7687f161 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:29.133455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f44ab965-b509-49ab-9905-621a7687f161 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:29.155587 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f44ab965-b509-49ab-9905-621a7687f161 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1281 microversion: 2.20 time: 0.296360 Jun 23 08:20:29.165510 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 17/30] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:28 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1281 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:29.186698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d8fd081a-187d-43a2-b373-15dc4b0c36fe tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68507b80>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:29.271326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d8fd081a-187d-43a2-b373-15dc4b0c36fe tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.088910 Jun 23 08:20:29.271792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 18/31] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:29 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:20:29.876666 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:20:29.877179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:20:29.877637 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:20:29.878044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:20:29.878457 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:20:29.880945 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c001ba3e-e952-4fbf-8a0d-6f2650a252ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:29.881552 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c001ba3e-e952-4fbf-8a0d-6f2650a252ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:29.890747 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c001ba3e-e952-4fbf-8a0d-6f2650a252ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:29.895287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:29.895742 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:29.896130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c001ba3e-e952-4fbf-8a0d-6f2650a252ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:29.896526 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:29.897161 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c001ba3e-e952-4fbf-8a0d-6f2650a252ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:29.897706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c001ba3e-e952-4fbf-8a0d-6f2650a252ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:29.898324 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:29.939564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Getting quotas for project 0e2534820f9840f5b45a08bb2428be70. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:20:29.951865 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Getting quotas for user eaf926af634c4ec2ada5fc8f4aa95e07 and project 0e2534820f9840f5b45a08bb2428be70. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:20:29.981993 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:20:29.984721 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:20:30.068246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c001ba3e-e952-4fbf-8a0d-6f2650a252ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:30.082940 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c001ba3e-e952-4fbf-8a0d-6f2650a252ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1225 microversion: 2.1 time: 0.205994 Jun 23 08:20:30.083980 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 19/32] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:29 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1225 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:30.115469 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b999007a-bc44-41ec-87c0-a047bd80a4d3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.139377 Jun 23 08:20:30.127831 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 14/33] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:20:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:20:30.142328 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6b989cd0-f6f9-4bf5-8b14-47495ff000ac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:30.142774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6b989cd0-f6f9-4bf5-8b14-47495ff000ac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:30.177289 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:30.178361 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:30.198881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:30.199940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:30.202956 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:30.203810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:30.285072 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6b989cd0-f6f9-4bf5-8b14-47495ff000ac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:30.294222 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6b989cd0-f6f9-4bf5-8b14-47495ff000ac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1215 microversion: 2.1 time: 0.159413 Jun 23 08:20:30.306152 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 20/34] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:30 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:30.316126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6ac89307-d2a7-45d7-9bee-a387d637ee07 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68513280>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:30.434289 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6ac89307-d2a7-45d7-9bee-a387d637ee07 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 200 len: 285 microversion: 2.1 time: 0.126718 Jun 23 08:20:30.435049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 21/35] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:30 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:30.443729 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1361852154", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b65b84c3-0a03-45d3-ab3d-aba7b8f8cc03"}], "security_groups": [{"name": "tempest-securitygroup--1131913452"}], "key_name": "tempest-keypair-386311704", "user_data": "}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:30.596113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:30.617594 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:30.620740 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:30.623416 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-24eeeb4e-5c15-40fa-8de9-09f2426cee51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1333 microversion: 2.20 time: 0.449644 Jun 23 08:20:30.625617 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 15/36] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:30 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1333 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:30.794609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.network.neutron [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] validate_networks() for [('b65b84c3-0a03-45d3-ab3d-aba7b8f8cc03', None, None, None, None, None)] {{(pid=117758) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:20:31.102323 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bb03989e-8bd2-4fef-9901-aa30061be855 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:31.103041 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bb03989e-8bd2-4fef-9901-aa30061be855 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:31.122270 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb03989e-8bd2-4fef-9901-aa30061be855 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:31.128154 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb03989e-8bd2-4fef-9901-aa30061be855 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:31.129378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb03989e-8bd2-4fef-9901-aa30061be855 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:31.129975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb03989e-8bd2-4fef-9901-aa30061be855 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:31.503116 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bb03989e-8bd2-4fef-9901-aa30061be855 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:31.533111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bb03989e-8bd2-4fef-9901-aa30061be855 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1273 microversion: 2.1 time: 0.434533 Jun 23 08:20:31.536578 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 16/37] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:31 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1273 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:31.556174 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ce92f417-622c-4c05-ba55-e0f0d219f5bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:31.558437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ce92f417-622c-4c05-ba55-e0f0d219f5bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:31.581060 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ce92f417-622c-4c05-ba55-e0f0d219f5bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:31.582672 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ce92f417-622c-4c05-ba55-e0f0d219f5bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:31.583729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ce92f417-622c-4c05-ba55-e0f0d219f5bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:31.600445 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ce92f417-622c-4c05-ba55-e0f0d219f5bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:32.138506 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Flavor limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:20:32.139822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Image limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:20:32.141021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Flavor pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:20:32.141774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Image pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:20:32.142695 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:20:32.156780 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:32.157940 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:32.159110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:32.159436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ce92f417-622c-4c05-ba55-e0f0d219f5bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:32.160375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:32.167918 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ce92f417-622c-4c05-ba55-e0f0d219f5bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1219 microversion: 2.1 time: 0.629245 Jun 23 08:20:32.173903 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 17/38] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:31 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1219 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:32.180777 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cb0f8e24-0836-46d5-a817-d9ad203632fd tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb684c8c10>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:32.199883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for project 4979d926d8894e3db358f16bd6bf7621. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:20:32.208929 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for user 938efacddf794fd18cd323043906b6c1 and project 4979d926d8894e3db358f16bd6bf7621. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:20:32.236300 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Going to run 1 instances... {{(pid=117758) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:20:32.238872 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:20:32.321828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-cb0f8e24-0836-46d5-a817-d9ad203632fd tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] HTTP exception thrown: Snapshot 0643182a-7472-41f3-b1c5-c6663c7675d0 could not be found. Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cb0f8e24-0836-46d5-a817-d9ad203632fd tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Request method failure captured: Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 HTTP/1.1 Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCI3nZehqyB2kdUR61Lc819JOEQl2ma5M6V_zrO86uzieyE1oJhshH6cvw-Z0wQHrPzYFUSowFP5LmsHvqwQVcgaz_ON9q4HFqjglZEB57mTjkCIFNPRs0VZIuZYpO_U4yreoHbm0bdM49o8BsqrL8LsdOtO3nyznRA4QyUHrwBKhzA Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 1c8a0a9fab3e42a58d3cb273c536922c Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:20:32.326535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c8a0a9fab3e42a58d3cb273c536922c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c8a0a9fab3e42a58d3cb273c536922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c8a0a9fab3e42a58d3cb273c536922c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c8a0a9fab3e42a58d3cb273c536922c"}]}] Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 1c8a0a9fab3e42a58d3cb273c536922c Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-VolumesSnapshotsTestJSON-1397542833-project Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 851d6918e1e64933b9bcacc4be364c76 Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1397542833-project Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Snapshot 0643182a-7472-41f3-b1c5-c6663c7675d0 could not be found. Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '0643182a-7472-41f3-b1c5-c6663c7675d0'} Jun 23 08:20:32.327890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0643182a-7472-41f3-b1c5-c6663c7675d0 could not be found. (HTTP 404) (Request-ID: req-e7a9cad2-9599-4f8d-a636-c79ff44275ec) Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:20:32.328616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:20:32.329591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0643182a-7472-41f3-b1c5-c6663c7675d0 could not be found. Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 08:20:32.330556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0643182a-7472-41f3-b1c5-c6663c7675d0 could not be found. Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0643182a-7472-41f3-b1c5-c6663c7675d0 could not be found. Jun 23 08:20:32.331596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:20:32.333955 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cb0f8e24-0836-46d5-a817-d9ad203632fd tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Returning 404 to user: Snapshot 0643182a-7472-41f3-b1c5-c6663c7675d0 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:20:32.335033 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cb0f8e24-0836-46d5-a817-d9ad203632fd tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0" status: 404 len: 111 microversion: 2.1 time: 0.158042 Jun 23 08:20:32.336150 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 18/39] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 08:20:32 2022] GET /compute/v2.1/os-snapshots/0643182a-7472-41f3-b1c5-c6663c7675d0 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:20:32.348915 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:32.349798 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:32.360846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:32.361609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:32.363488 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:32.367674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:32.514542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f94122f1-e69e-47bf-8c7a-f823baf2173d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.078361 Jun 23 08:20:32.515239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 22/40] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:20:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:20:32.559525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c5ccfca3-c61d-4569-8ade-0f89e9766456 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb6856d790>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:32.918165 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c5ccfca3-c61d-4569-8ade-0f89e9766456 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e" status: 202 len: 0 microversion: 2.1 time: 0.393775 Jun 23 08:20:32.918941 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 23/41] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:20:32 2022] DELETE /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:20:32.925766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-21b04d6c-f437-46fc-b5b9-a660731392a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:32.926375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-21b04d6c-f437-46fc-b5b9-a660731392a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:32.951721 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:32.969922 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:32.974580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:32.991468 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3e77fb94-76ed-422a-9997-0e6ae8839c47 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1339 microversion: 2.20 time: 0.653260 Jun 23 08:20:32.992134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 19/42] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:32 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1339 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:33.002488 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9ccb5516-bc57-428d-9490-4def253ff085 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:33.020076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9ccb5516-bc57-428d-9490-4def253ff085 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:33.046250 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9ccb5516-bc57-428d-9490-4def253ff085 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:33.047054 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9ccb5516-bc57-428d-9490-4def253ff085 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:33.050931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9ccb5516-bc57-428d-9490-4def253ff085 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:33.051877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9ccb5516-bc57-428d-9490-4def253ff085 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:33.178417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-21b04d6c-f437-46fc-b5b9-a660731392a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:33.195917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-21b04d6c-f437-46fc-b5b9-a660731392a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1241 microversion: 2.1 time: 0.275511 Jun 23 08:20:33.205651 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 24/43] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:32 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1241 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:33.216470 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4f6549db-8101-44da-8eed-00200d3d9c12 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68513dc0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:33.381508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-4f6549db-8101-44da-8eed-00200d3d9c12 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] HTTP exception thrown: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4f6549db-8101-44da-8eed-00200d3d9c12 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Request method failure captured: Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e HTTP/1.1 Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCI3nZehqyB2kdUR61Lc819JOEQl2ma5M6V_zrO86uzieyE1oJhshH6cvw-Z0wQHrPzYFUSowFP5LmsHvqwQVcgaz_ON9q4HFqjglZEB57mTjkCIFNPRs0VZIuZYpO_U4yreoHbm0bdM49o8BsqrL8LsdOtO3nyznRA4QyUHrwBKhzA Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 1c8a0a9fab3e42a58d3cb273c536922c Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:20:33.387766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c8a0a9fab3e42a58d3cb273c536922c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c8a0a9fab3e42a58d3cb273c536922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c8a0a9fab3e42a58d3cb273c536922c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c8a0a9fab3e42a58d3cb273c536922c"}]}] Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 1c8a0a9fab3e42a58d3cb273c536922c Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesSnapshotsTestJSON-1397542833-project Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 851d6918e1e64933b9bcacc4be364c76 Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1397542833-project Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '4196f237-c682-45ae-8cfd-576fcfa0f52e'} Jun 23 08:20:33.389204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. (HTTP 404) (Request-ID: req-18c87f3c-9836-4892-a2ed-09dc25b0aec2) Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.390084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:20:33.391326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 08:20:33.392680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4f6549db-8101-44da-8eed-00200d3d9c12 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Returning 404 to user: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4f6549db-8101-44da-8eed-00200d3d9c12 tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e" status: 404 len: 109 microversion: 2.1 time: 0.190265 Jun 23 08:20:33.394606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 25/44] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:20:33 2022] GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e => generated 109 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:20:33.435056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1a7155e9-0e05-4585-9111-ec9eca2ba3aa tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:33.441253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1a7155e9-0e05-4585-9111-ec9eca2ba3aa tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:33.478384 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a7155e9-0e05-4585-9111-ec9eca2ba3aa tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:33.484685 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a7155e9-0e05-4585-9111-ec9eca2ba3aa tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:33.485578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a7155e9-0e05-4585-9111-ec9eca2ba3aa tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:33.495442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a7155e9-0e05-4585-9111-ec9eca2ba3aa tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:33.761597 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1a7155e9-0e05-4585-9111-ec9eca2ba3aa tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:33.771644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1a7155e9-0e05-4585-9111-ec9eca2ba3aa tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1273 microversion: 2.1 time: 0.365084 Jun 23 08:20:33.783597 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 26/45] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:33 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1273 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:33.788659 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-98d964e6-c760-4117-84fe-87ea11047c4e tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68454af0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:33.847385 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-98d964e6-c760-4117-84fe-87ea11047c4e tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] HTTP exception thrown: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-98d964e6-c760-4117-84fe-87ea11047c4e tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Request method failure captured: Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e HTTP/1.1 Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCI3nZehqyB2kdUR61Lc819JOEQl2ma5M6V_zrO86uzieyE1oJhshH6cvw-Z0wQHrPzYFUSowFP5LmsHvqwQVcgaz_ON9q4HFqjglZEB57mTjkCIFNPRs0VZIuZYpO_U4yreoHbm0bdM49o8BsqrL8LsdOtO3nyznRA4QyUHrwBKhzA Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 1c8a0a9fab3e42a58d3cb273c536922c Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:20:33.849343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c8a0a9fab3e42a58d3cb273c536922c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c8a0a9fab3e42a58d3cb273c536922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c8a0a9fab3e42a58d3cb273c536922c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c8a0a9fab3e42a58d3cb273c536922c"}]}] Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 1c8a0a9fab3e42a58d3cb273c536922c Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesSnapshotsTestJSON-1397542833-project Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 851d6918e1e64933b9bcacc4be364c76 Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1397542833-project Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '4196f237-c682-45ae-8cfd-576fcfa0f52e'} Jun 23 08:20:33.850803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. (HTTP 404) (Request-ID: req-c5a0178e-15ea-407b-8b6f-500b40bf943e) Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.851628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 08:20:33.852758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 08:20:33.853978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-98d964e6-c760-4117-84fe-87ea11047c4e tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Returning 404 to user: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-98d964e6-c760-4117-84fe-87ea11047c4e tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e" status: 404 len: 109 microversion: 2.1 time: 0.066726 Jun 23 08:20:33.855145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 27/46] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:20:33 2022] DELETE /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:20:33.861593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a71709e2-48ea-466c-9d9d-e991ccbc563d tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Calling method '.version_select at 0x7feb68591790>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:33.913048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9ccb5516-bc57-428d-9490-4def253ff085 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:33.932491 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9ccb5516-bc57-428d-9490-4def253ff085 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1279 microversion: 2.1 time: 0.931460 Jun 23 08:20:33.937772 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-a71709e2-48ea-466c-9d9d-e991ccbc563d tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] HTTP exception thrown: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a71709e2-48ea-466c-9d9d-e991ccbc563d tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Request method failure captured: Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e HTTP/1.1 Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCI3nZehqyB2kdUR61Lc819JOEQl2ma5M6V_zrO86uzieyE1oJhshH6cvw-Z0wQHrPzYFUSowFP5LmsHvqwQVcgaz_ON9q4HFqjglZEB57mTjkCIFNPRs0VZIuZYpO_U4yreoHbm0bdM49o8BsqrL8LsdOtO3nyznRA4QyUHrwBKhzA Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 1c8a0a9fab3e42a58d3cb273c536922c Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:20:33.939866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c8a0a9fab3e42a58d3cb273c536922c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c8a0a9fab3e42a58d3cb273c536922c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c8a0a9fab3e42a58d3cb273c536922c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c8a0a9fab3e42a58d3cb273c536922c"}]}] Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 1c8a0a9fab3e42a58d3cb273c536922c Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1397542833 Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesSnapshotsTestJSON-1397542833-project Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 851d6918e1e64933b9bcacc4be364c76 Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1397542833-project Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '4196f237-c682-45ae-8cfd-576fcfa0f52e'} Jun 23 08:20:33.940996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. (HTTP 404) (Request-ID: req-42611775-967b-4777-bbfa-794ef273e483) Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.941690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:20:33.945866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 08:20:33.946926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a71709e2-48ea-466c-9d9d-e991ccbc563d tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] Returning 404 to user: Volume 4196f237-c682-45ae-8cfd-576fcfa0f52e could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a71709e2-48ea-466c-9d9d-e991ccbc563d tempest-VolumesSnapshotsTestJSON-1397542833 tempest-VolumesSnapshotsTestJSON-1397542833-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e" status: 404 len: 109 microversion: 2.1 time: 0.085252 Jun 23 08:20:33.948376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 28/47] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:20:33 2022] GET /compute/v2.1/os-volumes/4196f237-c682-45ae-8cfd-576fcfa0f52e => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:20:33.964425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 20/48] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:32 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1279 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:34.012783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:34.013564 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:34.025350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:34.025805 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:34.026594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:34.027037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:34.213526 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b2f4f5c2-1d3d-4bda-857f-80d5a7e6fd8b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:34.214255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b2f4f5c2-1d3d-4bda-857f-80d5a7e6fd8b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:34.230460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b2f4f5c2-1d3d-4bda-857f-80d5a7e6fd8b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:34.230913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b2f4f5c2-1d3d-4bda-857f-80d5a7e6fd8b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:34.242842 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b2f4f5c2-1d3d-4bda-857f-80d5a7e6fd8b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:34.246750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b2f4f5c2-1d3d-4bda-857f-80d5a7e6fd8b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:34.437080 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:34.446982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:34.454294 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:34.455660 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e7e8a97d-99d6-40e6-baaa-fe17579fb509 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1339 microversion: 2.20 time: 0.446832 Jun 23 08:20:34.470335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 29/49] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:34 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1339 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:34.790519 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-85346d87-4cb5-4dcf-96ad-0c20e7923245 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:34.791383 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-85346d87-4cb5-4dcf-96ad-0c20e7923245 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:34.819018 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-85346d87-4cb5-4dcf-96ad-0c20e7923245 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:34.821936 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-85346d87-4cb5-4dcf-96ad-0c20e7923245 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:34.824344 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-85346d87-4cb5-4dcf-96ad-0c20e7923245 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:34.824902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-85346d87-4cb5-4dcf-96ad-0c20e7923245 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:35.198406 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b2f4f5c2-1d3d-4bda-857f-80d5a7e6fd8b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:35.221002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b2f4f5c2-1d3d-4bda-857f-80d5a7e6fd8b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1237 microversion: 2.1 time: 1.011481 Jun 23 08:20:35.225921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 21/50] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:34 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1237 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:35.255034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b9c448cb-a1fa-4871-81c8-503762fc8937 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:35.263931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b9c448cb-a1fa-4871-81c8-503762fc8937 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:35.307523 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b9c448cb-a1fa-4871-81c8-503762fc8937 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:35.308163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b9c448cb-a1fa-4871-81c8-503762fc8937 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:35.308911 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b9c448cb-a1fa-4871-81c8-503762fc8937 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:35.311372 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b9c448cb-a1fa-4871-81c8-503762fc8937 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:36.566847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-85346d87-4cb5-4dcf-96ad-0c20e7923245 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:36.581087 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-85346d87-4cb5-4dcf-96ad-0c20e7923245 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1273 microversion: 2.1 time: 1.794971 Jun 23 08:20:36.582192 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 30/51] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:34 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1273 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:36.597406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:36.598700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:36.615079 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:36.615825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:36.616777 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:36.617395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:36.953333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:36.963136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:36.964738 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:36.980339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8b2cb673-9b70-43b1-a23a-03acfc8639c9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1339 microversion: 2.20 time: 0.382220 Jun 23 08:20:36.995534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 31/52] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:36 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1339 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:37.010204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-74228aa6-0f95-4802-aa83-eca1b11fc3a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:37.015322 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-74228aa6-0f95-4802-aa83-eca1b11fc3a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:37.032700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-74228aa6-0f95-4802-aa83-eca1b11fc3a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:37.033846 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-74228aa6-0f95-4802-aa83-eca1b11fc3a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:37.036063 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-74228aa6-0f95-4802-aa83-eca1b11fc3a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:37.038851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-74228aa6-0f95-4802-aa83-eca1b11fc3a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:37.396221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-74228aa6-0f95-4802-aa83-eca1b11fc3a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:37.408649 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-74228aa6-0f95-4802-aa83-eca1b11fc3a0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1299 microversion: 2.1 time: 0.411641 Jun 23 08:20:37.413147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 32/53] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:36 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1299 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:37.603704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-15494bd7-4398-483b-8c75-42fc4c936d78 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:37.604506 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-15494bd7-4398-483b-8c75-42fc4c936d78 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:37.615823 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-15494bd7-4398-483b-8c75-42fc4c936d78 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:37.617641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-15494bd7-4398-483b-8c75-42fc4c936d78 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:37.618507 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-15494bd7-4398-483b-8c75-42fc4c936d78 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:37.618892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-15494bd7-4398-483b-8c75-42fc4c936d78 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:37.957771 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b9c448cb-a1fa-4871-81c8-503762fc8937 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:38.003502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b9c448cb-a1fa-4871-81c8-503762fc8937 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 2.762424 Jun 23 08:20:38.007969 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 22/54] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:35 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:38.038265 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:38.041075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:38.087017 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:38.091141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:38.097249 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:38.100002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:38.407983 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:38.422290 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:38.429374 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:38.431181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-820a4f23-75a5-48e9-b724-eb63e44614ce tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1339 microversion: 2.20 time: 0.417787 Jun 23 08:20:38.432111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 23/55] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:38 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1339 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:38.441165 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8cd5facf-39da-4064-a188-cd7ef74d9b8c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:38.443940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8cd5facf-39da-4064-a188-cd7ef74d9b8c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:38.459053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8cd5facf-39da-4064-a188-cd7ef74d9b8c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:38.460161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8cd5facf-39da-4064-a188-cd7ef74d9b8c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:38.463443 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8cd5facf-39da-4064-a188-cd7ef74d9b8c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:38.464200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8cd5facf-39da-4064-a188-cd7ef74d9b8c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:38.522087 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-15494bd7-4398-483b-8c75-42fc4c936d78 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:38.530278 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-15494bd7-4398-483b-8c75-42fc4c936d78 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.934952 Jun 23 08:20:38.530871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 33/56] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:37 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:38.641796 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8cd5facf-39da-4064-a188-cd7ef74d9b8c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:38.657405 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8cd5facf-39da-4064-a188-cd7ef74d9b8c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1299 microversion: 2.1 time: 0.223431 Jun 23 08:20:38.664079 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 24/57] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:38 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:39.027174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ac553b71-90f6-47ec-9790-3ea65af5bf1d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:39.028102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ac553b71-90f6-47ec-9790-3ea65af5bf1d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:39.051231 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ac553b71-90f6-47ec-9790-3ea65af5bf1d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:39.051696 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ac553b71-90f6-47ec-9790-3ea65af5bf1d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:39.052494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ac553b71-90f6-47ec-9790-3ea65af5bf1d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:39.052993 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ac553b71-90f6-47ec-9790-3ea65af5bf1d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:39.450907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:39.451720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:39.483409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:39.483867 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:39.485027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:39.485158 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:39.926299 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:39.930207 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:39.941378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:39.953828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:39.955458 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9ac238a4-7124-4971-974f-44ecea56ed08 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1339 microversion: 2.20 time: 0.509537 Jun 23 08:20:39.956757 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 25/58] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:39 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1339 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:20:39.962322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-65f62bc8-c418-40d4-95e4-e2b44405deed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:39.968347 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-65f62bc8-c418-40d4-95e4-e2b44405deed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:39.993163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=26 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:40.004273 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65f62bc8-c418-40d4-95e4-e2b44405deed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:40.005073 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65f62bc8-c418-40d4-95e4-e2b44405deed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:40.006136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65f62bc8-c418-40d4-95e4-e2b44405deed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:40.006822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65f62bc8-c418-40d4-95e4-e2b44405deed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:40.415419 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ac553b71-90f6-47ec-9790-3ea65af5bf1d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:40.424256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ac553b71-90f6-47ec-9790-3ea65af5bf1d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 1.403048 Jun 23 08:20:40.434895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 34/59] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:39 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:40.440478 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3b87897d-c473-43e7-95b7-abc064aea64a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:40.441117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3b87897d-c473-43e7-95b7-abc064aea64a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:40.460895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b87897d-c473-43e7-95b7-abc064aea64a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:40.461878 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b87897d-c473-43e7-95b7-abc064aea64a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:40.463258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b87897d-c473-43e7-95b7-abc064aea64a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:40.463831 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b87897d-c473-43e7-95b7-abc064aea64a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:41.584076 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3b87897d-c473-43e7-95b7-abc064aea64a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:41.612797 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3b87897d-c473-43e7-95b7-abc064aea64a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 1.176543 Jun 23 08:20:41.619835 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 35/60] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:40 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:41.655566 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:41.663750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:41.692996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:41.693668 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:41.695865 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:41.703968 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:42.187078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=4 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:42.647825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:42.660614 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:42.669266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:42.676443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-80bfdb90-8394-4e99-8deb-545c53716e5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 1.049598 Jun 23 08:20:42.678732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 36/61] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:41 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:42.697884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-81627609-4ad3-4256-8191-9d5e7b8b9a81 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:42.701256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-81627609-4ad3-4256-8191-9d5e7b8b9a81 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:42.717125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-81627609-4ad3-4256-8191-9d5e7b8b9a81 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:42.718135 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-81627609-4ad3-4256-8191-9d5e7b8b9a81 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:42.719546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-81627609-4ad3-4256-8191-9d5e7b8b9a81 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:42.720233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-81627609-4ad3-4256-8191-9d5e7b8b9a81 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:42.755226 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-65f62bc8-c418-40d4-95e4-e2b44405deed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:42.768669 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-65f62bc8-c418-40d4-95e4-e2b44405deed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 2.808041 Jun 23 08:20:42.781872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 26/62] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:39 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 2824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:43.184227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=24 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:43.244750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-3a01750f-43b0-4e3a-ba4b-03a2e2777eb6 req-b36b6b79-c635-4d41-a2dd-b4d300f98fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621b2677-57b0-46a1-a540-efec39d1b018", "tag": "ad0fc4d0-bce3-4944-97da-42c68812609c"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:43.250905 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:43.292241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-3a01750f-43b0-4e3a-ba4b-03a2e2777eb6 req-b36b6b79-c635-4d41-a2dd-b4d300f98fc0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:43.292682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-3a01750f-43b0-4e3a-ba4b-03a2e2777eb6 req-b36b6b79-c635-4d41-a2dd-b4d300f98fc0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:43.358641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-3a01750f-43b0-4e3a-ba4b-03a2e2777eb6 req-b36b6b79-c635-4d41-a2dd-b4d300f98fc0 service nova] Creating event network-changed:ad0fc4d0-bce3-4944-97da-42c68812609c for instance 621b2677-57b0-46a1-a540-efec39d1b018 on hv-cinder-84721 Jun 23 08:20:43.359251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-3a01750f-43b0-4e3a-ba4b-03a2e2777eb6 req-b36b6b79-c635-4d41-a2dd-b4d300f98fc0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 08:20:43.363767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a2c1233-3854-4039-9bbd-cde4f935f0e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:43.364254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a2c1233-3854-4039-9bbd-cde4f935f0e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:43.365064 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a2c1233-3854-4039-9bbd-cde4f935f0e6 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:43.370309 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a2c1233-3854-4039-9bbd-cde4f935f0e6 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:43.406226 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.compute.rpcapi [None req-9a2c1233-3854-4039-9bbd-cde4f935f0e6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 08:20:43.407113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a2c1233-3854-4039-9bbd-cde4f935f0e6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117757) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 08:20:43.463052 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9a2c1233-3854-4039-9bbd-cde4f935f0e6 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.676412 Jun 23 08:20:43.463711 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 27/63] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:43.470519 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b73d0701-56af-41a9-a3b1-3227f34e081d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:43.471234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b73d0701-56af-41a9-a3b1-3227f34e081d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:43.489206 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b73d0701-56af-41a9-a3b1-3227f34e081d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:43.489653 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b73d0701-56af-41a9-a3b1-3227f34e081d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:43.492616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b73d0701-56af-41a9-a3b1-3227f34e081d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:43.493059 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b73d0701-56af-41a9-a3b1-3227f34e081d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:43.558809 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-81627609-4ad3-4256-8191-9d5e7b8b9a81 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:43.585045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-81627609-4ad3-4256-8191-9d5e7b8b9a81 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.904472 Jun 23 08:20:43.586511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 37/64] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:42 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:43.930383 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-821b43ea-e5d3-41ba-b967-2b12d0341627 req-80cb1d97-544b-4123-a8a7-58fb5438a8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2adbdb87-cc07-4747-9533-ed6cc8926aee", "tag": "09f817fd-0504-4e71-9bac-fe9a86e146b7"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:43.963308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-821b43ea-e5d3-41ba-b967-2b12d0341627 req-80cb1d97-544b-4123-a8a7-58fb5438a8de service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:43.970486 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-821b43ea-e5d3-41ba-b967-2b12d0341627 req-80cb1d97-544b-4123-a8a7-58fb5438a8de service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:44.057393 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-821b43ea-e5d3-41ba-b967-2b12d0341627 req-80cb1d97-544b-4123-a8a7-58fb5438a8de service nova] Creating event network-changed:09f817fd-0504-4e71-9bac-fe9a86e146b7 for instance 2adbdb87-cc07-4747-9533-ed6cc8926aee on hv-cinder-84721 Jun 23 08:20:44.067111 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-821b43ea-e5d3-41ba-b967-2b12d0341627 req-80cb1d97-544b-4123-a8a7-58fb5438a8de service nova] Acquired lock "compute-rpcapi-router" {{(pid=117758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 08:20:44.072160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-986a71a7-c269-42be-b847-ae31f3dbbf37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:44.074606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-986a71a7-c269-42be-b847-ae31f3dbbf37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:44.077993 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-986a71a7-c269-42be-b847-ae31f3dbbf37 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:44.080081 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-986a71a7-c269-42be-b847-ae31f3dbbf37 None None] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:44.123875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.compute.rpcapi [None req-986a71a7-c269-42be-b847-ae31f3dbbf37 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 08:20:44.124972 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-986a71a7-c269-42be-b847-ae31f3dbbf37 None None] Releasing lock "compute-rpcapi-router" {{(pid=117758) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 08:20:44.169043 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-986a71a7-c269-42be-b847-ae31f3dbbf37 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.579763 Jun 23 08:20:44.170425 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 38/65] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:44.176121 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:44.189732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:44.199638 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:44.200333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:44.202157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:44.205173 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:44.794634 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:44.805078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b73d0701-56af-41a9-a3b1-3227f34e081d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:44.822223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b73d0701-56af-41a9-a3b1-3227f34e081d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 1.357232 Jun 23 08:20:44.828042 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 28/66] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:43 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:44.830484 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:44.834472 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:44.840705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e07c407f-7d83-4f4c-868c-23aa559cb926 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.666275 Jun 23 08:20:44.845036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 39/67] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:44 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:44.847901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cb65b9a6-8232-4a25-87f7-025025ae038b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:44.849999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cb65b9a6-8232-4a25-87f7-025025ae038b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:44.861075 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9d9d9766-df25-4278-8535-0f3bfd62e50d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:44.863253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9d9d9766-df25-4278-8535-0f3bfd62e50d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:44.870531 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cb65b9a6-8232-4a25-87f7-025025ae038b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:44.871900 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cb65b9a6-8232-4a25-87f7-025025ae038b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:44.875274 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cb65b9a6-8232-4a25-87f7-025025ae038b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:44.877099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cb65b9a6-8232-4a25-87f7-025025ae038b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:44.885119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9d9d9766-df25-4278-8535-0f3bfd62e50d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:44.886390 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9d9d9766-df25-4278-8535-0f3bfd62e50d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:44.890797 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9d9d9766-df25-4278-8535-0f3bfd62e50d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:44.892544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9d9d9766-df25-4278-8535-0f3bfd62e50d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:45.177952 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9d9d9766-df25-4278-8535-0f3bfd62e50d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:45.188660 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9d9d9766-df25-4278-8535-0f3bfd62e50d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.341495 Jun 23 08:20:45.189559 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 40/68] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:44 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:45.595234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cb65b9a6-8232-4a25-87f7-025025ae038b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:45.604394 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cb65b9a6-8232-4a25-87f7-025025ae038b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.775110 Jun 23 08:20:45.612779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 29/69] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:44 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:45.849519 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ac5e96ff-243a-49e8-990f-0ccaa2db8c72 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:45.850343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ac5e96ff-243a-49e8-990f-0ccaa2db8c72 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:45.865348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:45.866629 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:45.876441 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:45.880773 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ac5e96ff-243a-49e8-990f-0ccaa2db8c72 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:45.881559 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:45.887350 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:45.888099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:45.888262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ac5e96ff-243a-49e8-990f-0ccaa2db8c72 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:45.890520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ac5e96ff-243a-49e8-990f-0ccaa2db8c72 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:45.894182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ac5e96ff-243a-49e8-990f-0ccaa2db8c72 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:46.198498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ac5e96ff-243a-49e8-990f-0ccaa2db8c72 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:46.209745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ac5e96ff-243a-49e8-990f-0ccaa2db8c72 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.369834 Jun 23 08:20:46.210506 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 41/70] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:45 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:46.224659 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a918cbf1-d1ba-4697-9a2a-e8cc7457eebf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:46.225379 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a918cbf1-d1ba-4697-9a2a-e8cc7457eebf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:46.235946 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a918cbf1-d1ba-4697-9a2a-e8cc7457eebf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:46.236374 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a918cbf1-d1ba-4697-9a2a-e8cc7457eebf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:46.239175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a918cbf1-d1ba-4697-9a2a-e8cc7457eebf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:46.239881 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a918cbf1-d1ba-4697-9a2a-e8cc7457eebf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:46.246696 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:46.638782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:46.648386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:46.655781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a918cbf1-d1ba-4697-9a2a-e8cc7457eebf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:46.658277 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:46.661015 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-281f4f17-1cc0-4e7b-8777-e5412910de7b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.800408 Jun 23 08:20:46.661995 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 30/71] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:45 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:46.683165 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a918cbf1-d1ba-4697-9a2a-e8cc7457eebf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.470983 Jun 23 08:20:46.684180 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2a7c6dde-ed77-41f9-86b8-8b636c27056b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:46.685520 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2a7c6dde-ed77-41f9-86b8-8b636c27056b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:46.686301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 42/72] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:46 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:46.697070 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-6ee85cdb-d1dd-4dda-b353-879136bf8800 req-0d127d73-04fb-4f6f-9c9f-1e6a41e42c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba31757-3f23-4c93-8016-2448fa5510b9", "tag": "0203a36b-327e-4646-9fe0-705599369659"}, {"name": "network-changed", "server_uuid": "795dfab2-6368-40d4-bf89-95f37e857ceb", "tag": "9cdd8d49-4a4d-48e0-bf8b-c4d771ada3d9"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:46.700035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2a7c6dde-ed77-41f9-86b8-8b636c27056b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:46.700513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2a7c6dde-ed77-41f9-86b8-8b636c27056b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:46.701316 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2a7c6dde-ed77-41f9-86b8-8b636c27056b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:46.701973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2a7c6dde-ed77-41f9-86b8-8b636c27056b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:46.715335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:46.723036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-6ee85cdb-d1dd-4dda-b353-879136bf8800 req-0d127d73-04fb-4f6f-9c9f-1e6a41e42c8c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:46.723577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-6ee85cdb-d1dd-4dda-b353-879136bf8800 req-0d127d73-04fb-4f6f-9c9f-1e6a41e42c8c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:46.756158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-6ee85cdb-d1dd-4dda-b353-879136bf8800 req-0d127d73-04fb-4f6f-9c9f-1e6a41e42c8c service nova] Creating event network-changed:0203a36b-327e-4646-9fe0-705599369659 for instance 8ba31757-3f23-4c93-8016-2448fa5510b9 on hv-cinder-84721 Jun 23 08:20:46.756644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-6ee85cdb-d1dd-4dda-b353-879136bf8800 req-0d127d73-04fb-4f6f-9c9f-1e6a41e42c8c service nova] Creating event network-changed:9cdd8d49-4a4d-48e0-bf8b-c4d771ada3d9 for instance 795dfab2-6368-40d4-bf89-95f37e857ceb on hv-cinder-84721 Jun 23 08:20:46.777155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-6ee85cdb-d1dd-4dda-b353-879136bf8800 req-0d127d73-04fb-4f6f-9c9f-1e6a41e42c8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089195 Jun 23 08:20:46.779655 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 43/73] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:47.007774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2a7c6dde-ed77-41f9-86b8-8b636c27056b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:47.011948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:47.016876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2a7c6dde-ed77-41f9-86b8-8b636c27056b tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.352561 Jun 23 08:20:47.020806 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 31/74] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:46 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:47.228822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-730dc0cf-7b19-405a-a306-ac770f6cc938 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:47.230189 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-730dc0cf-7b19-405a-a306-ac770f6cc938 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:47.237824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-730dc0cf-7b19-405a-a306-ac770f6cc938 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:47.238519 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-730dc0cf-7b19-405a-a306-ac770f6cc938 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:47.239408 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-730dc0cf-7b19-405a-a306-ac770f6cc938 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:47.241933 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-730dc0cf-7b19-405a-a306-ac770f6cc938 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:47.680643 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:47.681332 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:47.687352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-730dc0cf-7b19-405a-a306-ac770f6cc938 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:47.695339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-730dc0cf-7b19-405a-a306-ac770f6cc938 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.470691 Jun 23 08:20:47.696300 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 44/75] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:47 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:47.702996 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:47.702996 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:47.703856 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:47.704281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:47.716065 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4704c43c-e2a7-4f6f-9db9-d8d2e415a8e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:47.720116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4704c43c-e2a7-4f6f-9db9-d8d2e415a8e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:47.728900 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4704c43c-e2a7-4f6f-9db9-d8d2e415a8e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:47.729349 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4704c43c-e2a7-4f6f-9db9-d8d2e415a8e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:47.730317 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4704c43c-e2a7-4f6f-9db9-d8d2e415a8e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:47.730686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4704c43c-e2a7-4f6f-9db9-d8d2e415a8e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:47.921563 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:47.931390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:47.933047 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:47.934681 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-137ed1a9-2325-4101-9b3f-85b9ba72ad56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.258260 Jun 23 08:20:47.935796 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 32/76] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:47 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:20:47.939497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4704c43c-e2a7-4f6f-9db9-d8d2e415a8e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:47.949307 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4704c43c-e2a7-4f6f-9db9-d8d2e415a8e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.251302 Jun 23 08:20:47.959359 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 45/77] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:47 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:48.037116 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-379cfd8c-d7ed-4865-b700-5ac1a87cceb2 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:48.038535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-379cfd8c-d7ed-4865-b700-5ac1a87cceb2 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:48.046019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-379cfd8c-d7ed-4865-b700-5ac1a87cceb2 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.046416 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-379cfd8c-d7ed-4865-b700-5ac1a87cceb2 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:48.047378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-379cfd8c-d7ed-4865-b700-5ac1a87cceb2 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.047857 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-379cfd8c-d7ed-4865-b700-5ac1a87cceb2 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:48.193934 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-379cfd8c-d7ed-4865-b700-5ac1a87cceb2 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:48.203917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-379cfd8c-d7ed-4865-b700-5ac1a87cceb2 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.170883 Jun 23 08:20:48.204718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 33/78] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:48 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:48.715875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-921d1d57-72e9-4cc4-a1ff-6e266b0b73ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:48.716791 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-921d1d57-72e9-4cc4-a1ff-6e266b0b73ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:48.723461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-921d1d57-72e9-4cc4-a1ff-6e266b0b73ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.724153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-921d1d57-72e9-4cc4-a1ff-6e266b0b73ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:48.725090 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-921d1d57-72e9-4cc4-a1ff-6e266b0b73ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.725696 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-921d1d57-72e9-4cc4-a1ff-6e266b0b73ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:48.800800 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-58e2e806-f179-4ad9-9a0c-bfab0566ce0f req-7110830d-ea94-4928-baad-3edac2a6662d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62a72a3-1376-4284-94a0-d57fbe81f1b9", "tag": "95dc486f-023d-4b75-87c7-155fbce47ca4"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:20:48.811543 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-58e2e806-f179-4ad9-9a0c-bfab0566ce0f req-7110830d-ea94-4928-baad-3edac2a6662d service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.812305 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-58e2e806-f179-4ad9-9a0c-bfab0566ce0f req-7110830d-ea94-4928-baad-3edac2a6662d service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:48.825616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-58e2e806-f179-4ad9-9a0c-bfab0566ce0f req-7110830d-ea94-4928-baad-3edac2a6662d service nova] Creating event network-changed:95dc486f-023d-4b75-87c7-155fbce47ca4 for instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 on hv-cinder-84721 Jun 23 08:20:48.837940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-58e2e806-f179-4ad9-9a0c-bfab0566ce0f req-7110830d-ea94-4928-baad-3edac2a6662d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038540 Jun 23 08:20:48.838573 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 34/79] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:20:48.882714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-921d1d57-72e9-4cc4-a1ff-6e266b0b73ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:48.890520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-921d1d57-72e9-4cc4-a1ff-6e266b0b73ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.179939 Jun 23 08:20:48.891085 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 46/80] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:48 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:48.958755 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:48.959990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:48.970869 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.972120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:48.973736 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.974623 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:48.978973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d14c08f0-17af-4c94-be28-d8925d9f46dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:48.982306 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d14c08f0-17af-4c94-be28-d8925d9f46dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:48.990196 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d14c08f0-17af-4c94-be28-d8925d9f46dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.990718 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d14c08f0-17af-4c94-be28-d8925d9f46dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:48.991644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d14c08f0-17af-4c94-be28-d8925d9f46dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:48.992239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d14c08f0-17af-4c94-be28-d8925d9f46dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:49.116429 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:49.126686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:49.128375 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:49.129644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7330f0b1-a8ef-4e2e-9dae-daf2d335655b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.179770 Jun 23 08:20:49.130210 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 35/81] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:48 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:49.172539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d14c08f0-17af-4c94-be28-d8925d9f46dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:49.183755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d14c08f0-17af-4c94-be28-d8925d9f46dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.216609 Jun 23 08:20:49.184561 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 47/82] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:48 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:49.221912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c6d1b4c5-e6bc-4442-b475-73aa566b709e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:49.222512 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c6d1b4c5-e6bc-4442-b475-73aa566b709e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:49.228819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c6d1b4c5-e6bc-4442-b475-73aa566b709e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:49.229269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c6d1b4c5-e6bc-4442-b475-73aa566b709e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:49.230026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c6d1b4c5-e6bc-4442-b475-73aa566b709e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:49.230449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c6d1b4c5-e6bc-4442-b475-73aa566b709e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:49.367594 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c6d1b4c5-e6bc-4442-b475-73aa566b709e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:49.376197 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c6d1b4c5-e6bc-4442-b475-73aa566b709e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.158089 Jun 23 08:20:49.377164 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 36/83] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:49 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:49.907748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4a97f575-d808-4951-8bc2-fda412e3d67a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:49.908342 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4a97f575-d808-4951-8bc2-fda412e3d67a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:49.914426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4a97f575-d808-4951-8bc2-fda412e3d67a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:49.914897 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4a97f575-d808-4951-8bc2-fda412e3d67a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:49.915683 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4a97f575-d808-4951-8bc2-fda412e3d67a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:49.916108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4a97f575-d808-4951-8bc2-fda412e3d67a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:50.059048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4a97f575-d808-4951-8bc2-fda412e3d67a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:50.066872 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4a97f575-d808-4951-8bc2-fda412e3d67a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.163213 Jun 23 08:20:50.067470 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 48/84] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:49 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:50.147914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:50.148515 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:50.155985 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:50.156417 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:50.157219 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:50.158089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:50.208779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c3e5947c-7549-4ea2-87e0-669de16f0a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:50.209657 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c3e5947c-7549-4ea2-87e0-669de16f0a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:50.216182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c3e5947c-7549-4ea2-87e0-669de16f0a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:50.216693 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c3e5947c-7549-4ea2-87e0-669de16f0a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:50.217576 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c3e5947c-7549-4ea2-87e0-669de16f0a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:50.218004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c3e5947c-7549-4ea2-87e0-669de16f0a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:50.314871 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:50.324285 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:50.326270 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:50.327628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-25a5d1ab-0a11-4c14-bcb9-46c5bc499d6f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.183609 Jun 23 08:20:50.328377 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 37/85] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:50 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:50.361620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c3e5947c-7549-4ea2-87e0-669de16f0a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:50.369873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c3e5947c-7549-4ea2-87e0-669de16f0a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.172810 Jun 23 08:20:50.370439 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 49/86] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:50 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:50.396839 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cb5a721e-b7be-4a0d-b0d5-8281686887d0 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:50.397525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cb5a721e-b7be-4a0d-b0d5-8281686887d0 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:50.403560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cb5a721e-b7be-4a0d-b0d5-8281686887d0 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:50.404036 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cb5a721e-b7be-4a0d-b0d5-8281686887d0 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:50.404779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cb5a721e-b7be-4a0d-b0d5-8281686887d0 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:50.405203 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cb5a721e-b7be-4a0d-b0d5-8281686887d0 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:50.550334 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cb5a721e-b7be-4a0d-b0d5-8281686887d0 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:50.558614 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cb5a721e-b7be-4a0d-b0d5-8281686887d0 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.166112 Jun 23 08:20:50.559189 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 38/87] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:50 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:51.083562 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8b80de0b-10ac-4cc5-bd94-f57cd0cfac3f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:51.084133 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8b80de0b-10ac-4cc5-bd94-f57cd0cfac3f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:51.090172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b80de0b-10ac-4cc5-bd94-f57cd0cfac3f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:51.090611 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b80de0b-10ac-4cc5-bd94-f57cd0cfac3f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:51.091364 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b80de0b-10ac-4cc5-bd94-f57cd0cfac3f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:51.091799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b80de0b-10ac-4cc5-bd94-f57cd0cfac3f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:51.219357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8b80de0b-10ac-4cc5-bd94-f57cd0cfac3f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:51.227948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8b80de0b-10ac-4cc5-bd94-f57cd0cfac3f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.147844 Jun 23 08:20:51.228587 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 50/88] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:51 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:51.345992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:51.346597 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:51.352735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:51.353149 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:51.353912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:51.354315 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:51.386844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-713d5f49-568d-4707-8693-8ebcacade25c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:51.387534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-713d5f49-568d-4707-8693-8ebcacade25c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:51.403816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-713d5f49-568d-4707-8693-8ebcacade25c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:51.404670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-713d5f49-568d-4707-8693-8ebcacade25c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:51.405583 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-713d5f49-568d-4707-8693-8ebcacade25c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:51.406135 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-713d5f49-568d-4707-8693-8ebcacade25c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:51.497426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:51.506595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:51.508599 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:51.509883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-43d80562-bf6c-47fe-b207-d5c91571f219 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.167959 Jun 23 08:20:51.510782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 39/89] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:51 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:51.575569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-fb503657-dd05-4817-ad59-97b2f943f194 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:51.576292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-fb503657-dd05-4817-ad59-97b2f943f194 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:51.579797 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-713d5f49-568d-4707-8693-8ebcacade25c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:51.582819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fb503657-dd05-4817-ad59-97b2f943f194 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:51.583283 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fb503657-dd05-4817-ad59-97b2f943f194 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:51.584045 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fb503657-dd05-4817-ad59-97b2f943f194 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:51.584660 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fb503657-dd05-4817-ad59-97b2f943f194 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:51.588298 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-713d5f49-568d-4707-8693-8ebcacade25c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.205345 Jun 23 08:20:51.588988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 51/90] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:51 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:51.728628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fb503657-dd05-4817-ad59-97b2f943f194 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:51.736321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-fb503657-dd05-4817-ad59-97b2f943f194 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.164651 Jun 23 08:20:51.736892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 40/91] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:51 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:52.245609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-071717ea-339c-4713-8268-77eefcd617ff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:52.246705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-071717ea-339c-4713-8268-77eefcd617ff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:52.257385 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-071717ea-339c-4713-8268-77eefcd617ff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:52.258283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-071717ea-339c-4713-8268-77eefcd617ff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:52.259198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-071717ea-339c-4713-8268-77eefcd617ff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:52.259723 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-071717ea-339c-4713-8268-77eefcd617ff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:52.408763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-071717ea-339c-4713-8268-77eefcd617ff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:52.417957 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-071717ea-339c-4713-8268-77eefcd617ff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.176210 Jun 23 08:20:52.427322 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 52/92] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:52 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:52.530791 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:52.531442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:52.537884 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:52.538508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:52.539335 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:52.539771 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:52.606153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-998804e3-0ba0-40ea-a765-d18d22394ee1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:52.607431 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-998804e3-0ba0-40ea-a765-d18d22394ee1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:52.613963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-998804e3-0ba0-40ea-a765-d18d22394ee1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:52.614409 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-998804e3-0ba0-40ea-a765-d18d22394ee1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:52.615176 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-998804e3-0ba0-40ea-a765-d18d22394ee1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:52.615636 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-998804e3-0ba0-40ea-a765-d18d22394ee1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:52.682691 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:52.692286 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:52.694402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:52.695792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2e623a17-d9d0-4b2d-8b60-0d4d9ff1b508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.171342 Jun 23 08:20:52.699338 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 41/93] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:52 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:52.757749 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-998804e3-0ba0-40ea-a765-d18d22394ee1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:52.761274 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b17cec93-cb73-43f3-9dc5-f8b183033865 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:52.761919 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b17cec93-cb73-43f3-9dc5-f8b183033865 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:52.768368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b17cec93-cb73-43f3-9dc5-f8b183033865 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:52.768887 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-998804e3-0ba0-40ea-a765-d18d22394ee1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.166857 Jun 23 08:20:52.769050 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b17cec93-cb73-43f3-9dc5-f8b183033865 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:52.769786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 53/94] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:52 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:52.769976 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b17cec93-cb73-43f3-9dc5-f8b183033865 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:52.770493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b17cec93-cb73-43f3-9dc5-f8b183033865 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:52.906105 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b17cec93-cb73-43f3-9dc5-f8b183033865 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:52.914020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b17cec93-cb73-43f3-9dc5-f8b183033865 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.164247 Jun 23 08:20:52.914953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 42/95] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:52 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:53.436527 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6dc42c24-5886-438a-8e67-1b85d937f920 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:53.437737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6dc42c24-5886-438a-8e67-1b85d937f920 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:53.444718 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dc42c24-5886-438a-8e67-1b85d937f920 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:53.445371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dc42c24-5886-438a-8e67-1b85d937f920 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:53.446430 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dc42c24-5886-438a-8e67-1b85d937f920 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:53.447011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dc42c24-5886-438a-8e67-1b85d937f920 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:53.718964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:53.720779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:53.729614 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:53.733790 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:53.734848 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:53.737895 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:53.738534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:53.802225 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6dc42c24-5886-438a-8e67-1b85d937f920 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:53.816530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6dc42c24-5886-438a-8e67-1b85d937f920 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.384055 Jun 23 08:20:53.817767 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 54/96] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:53 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:53.823676 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0db2df47-041c-4046-a3e0-ae6f433e784b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:53.824438 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0db2df47-041c-4046-a3e0-ae6f433e784b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:53.853595 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0db2df47-041c-4046-a3e0-ae6f433e784b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:53.854055 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0db2df47-041c-4046-a3e0-ae6f433e784b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:53.854862 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0db2df47-041c-4046-a3e0-ae6f433e784b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:53.855352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0db2df47-041c-4046-a3e0-ae6f433e784b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:53.960188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:53.971667 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:53.973576 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:53.976165 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6e9178b6-1ef5-4ce5-bcea-e25dee402fc0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.262484 Jun 23 08:20:53.979435 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 43/97] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:53 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:20:53.986938 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8396a274-d0d3-474d-9b67-2159816e5884 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:53.987786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8396a274-d0d3-474d-9b67-2159816e5884 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:53.997831 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8396a274-d0d3-474d-9b67-2159816e5884 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:53.999718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8396a274-d0d3-474d-9b67-2159816e5884 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:54.000938 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8396a274-d0d3-474d-9b67-2159816e5884 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:54.001568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8396a274-d0d3-474d-9b67-2159816e5884 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:54.035169 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0db2df47-041c-4046-a3e0-ae6f433e784b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:54.049327 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0db2df47-041c-4046-a3e0-ae6f433e784b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.230298 Jun 23 08:20:54.055409 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 55/98] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:53 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:54.162513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8396a274-d0d3-474d-9b67-2159816e5884 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:54.170017 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8396a274-d0d3-474d-9b67-2159816e5884 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.188988 Jun 23 08:20:54.170579 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 44/99] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:53 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:54.848921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-63182e30-03f8-4b72-a62e-1eb01e11a224 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:54.849599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-63182e30-03f8-4b72-a62e-1eb01e11a224 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:54.851820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:54.857968 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-63182e30-03f8-4b72-a62e-1eb01e11a224 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:54.858776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-63182e30-03f8-4b72-a62e-1eb01e11a224 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:54.859641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-63182e30-03f8-4b72-a62e-1eb01e11a224 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:54.860209 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-63182e30-03f8-4b72-a62e-1eb01e11a224 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:55.002397 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:55.003110 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:55.011688 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:55.012933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:55.014532 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:55.015096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:55.085262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-63182e30-03f8-4b72-a62e-1eb01e11a224 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:55.094210 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-63182e30-03f8-4b72-a62e-1eb01e11a224 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.249637 Jun 23 08:20:55.094782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 56/100] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:54 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:55.099525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5c061752-45f4-405e-9147-401a26b022ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:55.100130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5c061752-45f4-405e-9147-401a26b022ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:55.106086 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5c061752-45f4-405e-9147-401a26b022ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:55.106532 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5c061752-45f4-405e-9147-401a26b022ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:55.108052 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5c061752-45f4-405e-9147-401a26b022ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:55.108495 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5c061752-45f4-405e-9147-401a26b022ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:55.254653 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:55.274102 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:55.276594 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:55.278015 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a6964a78-cf7d-4d97-9fbf-753ea203ab2b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.284916 Jun 23 08:20:55.279386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 45/101] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:54 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:55.288185 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-68f5afc4-47b5-4115-92a4-d4ee2f471b6f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:55.289335 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-68f5afc4-47b5-4115-92a4-d4ee2f471b6f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:55.315718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-68f5afc4-47b5-4115-92a4-d4ee2f471b6f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:55.316447 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-68f5afc4-47b5-4115-92a4-d4ee2f471b6f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:55.317479 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-68f5afc4-47b5-4115-92a4-d4ee2f471b6f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:55.318059 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-68f5afc4-47b5-4115-92a4-d4ee2f471b6f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:55.352110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5c061752-45f4-405e-9147-401a26b022ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:55.376010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5c061752-45f4-405e-9147-401a26b022ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.279949 Jun 23 08:20:55.377971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 57/102] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:55 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:55.500443 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-68f5afc4-47b5-4115-92a4-d4ee2f471b6f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:55.518021 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-68f5afc4-47b5-4115-92a4-d4ee2f471b6f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.237098 Jun 23 08:20:55.518621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 46/103] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:55 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:56.113003 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-aa704bfc-84f6-43d3-93ec-3bf20e527def tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:56.113613 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-aa704bfc-84f6-43d3-93ec-3bf20e527def tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:56.121902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aa704bfc-84f6-43d3-93ec-3bf20e527def tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:56.122348 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aa704bfc-84f6-43d3-93ec-3bf20e527def tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:56.123542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aa704bfc-84f6-43d3-93ec-3bf20e527def tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:56.124037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aa704bfc-84f6-43d3-93ec-3bf20e527def tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:56.269385 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-aa704bfc-84f6-43d3-93ec-3bf20e527def tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:56.278568 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-aa704bfc-84f6-43d3-93ec-3bf20e527def tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.169729 Jun 23 08:20:56.279258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 58/104] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:56 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:56.298292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:56.298892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:56.305037 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:56.305478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:56.306231 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:56.306843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:56.394471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-45d17912-c3c9-464a-b63a-394ac23c0e61 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:56.395111 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-45d17912-c3c9-464a-b63a-394ac23c0e61 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:56.401961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-45d17912-c3c9-464a-b63a-394ac23c0e61 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:56.402413 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-45d17912-c3c9-464a-b63a-394ac23c0e61 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:56.403172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-45d17912-c3c9-464a-b63a-394ac23c0e61 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:56.403831 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-45d17912-c3c9-464a-b63a-394ac23c0e61 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:56.432883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:56.491484 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:56.509606 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:56.512764 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:56.514050 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-959c7d37-1e8b-4aad-a489-7b406be852d7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.219669 Jun 23 08:20:56.514795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 47/105] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:56 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:56.536472 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ec205708-bd3d-475a-a97e-d14c628e6ce1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:56.538043 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ec205708-bd3d-475a-a97e-d14c628e6ce1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:56.546184 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec205708-bd3d-475a-a97e-d14c628e6ce1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:56.546891 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec205708-bd3d-475a-a97e-d14c628e6ce1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:56.547943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec205708-bd3d-475a-a97e-d14c628e6ce1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:56.548611 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec205708-bd3d-475a-a97e-d14c628e6ce1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:56.559711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-45d17912-c3c9-464a-b63a-394ac23c0e61 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:56.575057 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-45d17912-c3c9-464a-b63a-394ac23c0e61 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.184216 Jun 23 08:20:56.576955 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 59/106] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:56 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:56.777565 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ec205708-bd3d-475a-a97e-d14c628e6ce1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:56.787734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ec205708-bd3d-475a-a97e-d14c628e6ce1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.255250 Jun 23 08:20:56.788315 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 48/107] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:56 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:57.308463 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-804c0120-b206-4b7b-934b-16bbc4bddd78 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:57.308940 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-804c0120-b206-4b7b-934b-16bbc4bddd78 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:57.317029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-804c0120-b206-4b7b-934b-16bbc4bddd78 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:57.317549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-804c0120-b206-4b7b-934b-16bbc4bddd78 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:57.318362 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-804c0120-b206-4b7b-934b-16bbc4bddd78 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:57.319377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-804c0120-b206-4b7b-934b-16bbc4bddd78 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:57.504204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-804c0120-b206-4b7b-934b-16bbc4bddd78 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:57.516064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-804c0120-b206-4b7b-934b-16bbc4bddd78 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.221888 Jun 23 08:20:57.517665 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 60/108] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:57 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:57.533964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:57.535124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:57.542573 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:57.543346 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:57.545091 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:57.545837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:57.553789 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:20:57.595848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5ed49e4f-632b-47d4-9f22-bb36de0c16a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:57.597115 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5ed49e4f-632b-47d4-9f22-bb36de0c16a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:57.608398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5ed49e4f-632b-47d4-9f22-bb36de0c16a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:57.609286 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5ed49e4f-632b-47d4-9f22-bb36de0c16a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:57.610309 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5ed49e4f-632b-47d4-9f22-bb36de0c16a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:57.611079 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5ed49e4f-632b-47d4-9f22-bb36de0c16a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:57.722370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:57.737254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:57.740043 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:57.741395 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5842d1fc-7206-44c1-8f39-182860101ec3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.213043 Jun 23 08:20:57.742803 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 49/109] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:57 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:57.773864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5ed49e4f-632b-47d4-9f22-bb36de0c16a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:57.784033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5ed49e4f-632b-47d4-9f22-bb36de0c16a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.191813 Jun 23 08:20:57.784624 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 61/110] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:57 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:57.806324 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-888f0454-6499-4bff-995b-fdad112778fd tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:57.806938 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-888f0454-6499-4bff-995b-fdad112778fd tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:57.813675 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-888f0454-6499-4bff-995b-fdad112778fd tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:57.814127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-888f0454-6499-4bff-995b-fdad112778fd tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:57.814998 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-888f0454-6499-4bff-995b-fdad112778fd tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:57.815541 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-888f0454-6499-4bff-995b-fdad112778fd tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:57.962855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-888f0454-6499-4bff-995b-fdad112778fd tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:57.976456 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-888f0454-6499-4bff-995b-fdad112778fd tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.174279 Jun 23 08:20:57.977024 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 50/111] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:57 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:58.535716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a1140da0-f1af-4c6c-a8f2-d440e9d26fb6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:58.536330 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a1140da0-f1af-4c6c-a8f2-d440e9d26fb6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:58.544663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a1140da0-f1af-4c6c-a8f2-d440e9d26fb6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:58.545136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a1140da0-f1af-4c6c-a8f2-d440e9d26fb6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:58.545985 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a1140da0-f1af-4c6c-a8f2-d440e9d26fb6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:58.546437 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a1140da0-f1af-4c6c-a8f2-d440e9d26fb6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:58.699956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a1140da0-f1af-4c6c-a8f2-d440e9d26fb6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:58.708496 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a1140da0-f1af-4c6c-a8f2-d440e9d26fb6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.176869 Jun 23 08:20:58.709051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 62/112] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:58 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:58.760255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:58.760865 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:58.767056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:58.767536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:58.768305 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:58.768768 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:58.801834 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-31e6c463-5a89-4a67-b0cf-c0110e53b625 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:58.802436 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-31e6c463-5a89-4a67-b0cf-c0110e53b625 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:58.810845 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-31e6c463-5a89-4a67-b0cf-c0110e53b625 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:58.811528 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-31e6c463-5a89-4a67-b0cf-c0110e53b625 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:58.813037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-31e6c463-5a89-4a67-b0cf-c0110e53b625 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:58.813517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-31e6c463-5a89-4a67-b0cf-c0110e53b625 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:58.943092 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:58.960996 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:58.962499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:58.963657 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8351d70a-c524-4f18-abc1-3eea53238671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.207356 Jun 23 08:20:58.964254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 51/113] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:58 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:20:58.986125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-31e6c463-5a89-4a67-b0cf-c0110e53b625 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:58.994402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3eb0943c-db34-4ba7-99c1-f905e26b1cb1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:58.995319 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3eb0943c-db34-4ba7-99c1-f905e26b1cb1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:58.997178 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-31e6c463-5a89-4a67-b0cf-c0110e53b625 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.199785 Jun 23 08:20:58.998667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 63/114] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:58 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:59.003015 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3eb0943c-db34-4ba7-99c1-f905e26b1cb1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:59.003506 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3eb0943c-db34-4ba7-99c1-f905e26b1cb1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:59.004246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3eb0943c-db34-4ba7-99c1-f905e26b1cb1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:59.004676 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3eb0943c-db34-4ba7-99c1-f905e26b1cb1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:59.149615 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3eb0943c-db34-4ba7-99c1-f905e26b1cb1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:59.157440 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3eb0943c-db34-4ba7-99c1-f905e26b1cb1 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.167531 Jun 23 08:20:59.157992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 52/115] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:58 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:20:59.725039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d503544d-cf2c-4472-8458-c5451bfd6800 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:59.725652 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d503544d-cf2c-4472-8458-c5451bfd6800 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:59.731647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d503544d-cf2c-4472-8458-c5451bfd6800 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:59.732176 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d503544d-cf2c-4472-8458-c5451bfd6800 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:59.733038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d503544d-cf2c-4472-8458-c5451bfd6800 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:59.733471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d503544d-cf2c-4472-8458-c5451bfd6800 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:59.877518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d503544d-cf2c-4472-8458-c5451bfd6800 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:20:59.885073 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d503544d-cf2c-4472-8458-c5451bfd6800 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.164023 Jun 23 08:20:59.885706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 64/116] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:20:59 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:20:59.982303 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:20:59.982822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:20:59.989042 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:59.989462 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:20:59.990099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:20:59.990534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:00.016499 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ee7256a0-913e-488c-ae69-9f980ec7dbb6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:00.017110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ee7256a0-913e-488c-ae69-9f980ec7dbb6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:00.023225 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ee7256a0-913e-488c-ae69-9f980ec7dbb6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:00.023685 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ee7256a0-913e-488c-ae69-9f980ec7dbb6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:00.024422 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ee7256a0-913e-488c-ae69-9f980ec7dbb6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:00.025066 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ee7256a0-913e-488c-ae69-9f980ec7dbb6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:00.128817 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:00.137620 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:00.139261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:00.140371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-96ccfebb-44f5-4032-b846-caaf070ab964 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.162340 Jun 23 08:21:00.140924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 53/117] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:20:59 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:00.169318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ee7256a0-913e-488c-ae69-9f980ec7dbb6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:00.174575 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cf470d62-2753-43c4-82e4-201564a5ff5d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:00.175150 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cf470d62-2753-43c4-82e4-201564a5ff5d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:00.176834 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ee7256a0-913e-488c-ae69-9f980ec7dbb6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.164890 Jun 23 08:21:00.181580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cf470d62-2753-43c4-82e4-201564a5ff5d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:00.182028 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cf470d62-2753-43c4-82e4-201564a5ff5d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:00.182935 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cf470d62-2753-43c4-82e4-201564a5ff5d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:00.183427 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cf470d62-2753-43c4-82e4-201564a5ff5d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:00.192584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 65/118] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:00 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:00.333209 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cf470d62-2753-43c4-82e4-201564a5ff5d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:00.340764 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cf470d62-2753-43c4-82e4-201564a5ff5d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.169992 Jun 23 08:21:00.341655 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 54/119] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:00 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:00.902543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a817f74d-29f9-4e62-ac2b-2ae07ac4d3dd tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:00.904067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a817f74d-29f9-4e62-ac2b-2ae07ac4d3dd tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:00.916783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a817f74d-29f9-4e62-ac2b-2ae07ac4d3dd tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:00.919165 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a817f74d-29f9-4e62-ac2b-2ae07ac4d3dd tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:00.920243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a817f74d-29f9-4e62-ac2b-2ae07ac4d3dd tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:00.922787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a817f74d-29f9-4e62-ac2b-2ae07ac4d3dd tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:01.120887 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a817f74d-29f9-4e62-ac2b-2ae07ac4d3dd tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:01.131525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a817f74d-29f9-4e62-ac2b-2ae07ac4d3dd tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.233155 Jun 23 08:21:01.132300 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 66/120] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:00 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:01.159319 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:01.160447 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:01.168247 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:01.168688 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:01.169529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:01.169984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:01.200667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-45046699-5612-4223-90b4-89b858ae1eae tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:01.202002 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-45046699-5612-4223-90b4-89b858ae1eae tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:01.208733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-45046699-5612-4223-90b4-89b858ae1eae tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:01.209469 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-45046699-5612-4223-90b4-89b858ae1eae tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:01.210451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-45046699-5612-4223-90b4-89b858ae1eae tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:01.211110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-45046699-5612-4223-90b4-89b858ae1eae tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:01.346344 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:01.361058 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:01.364711 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:01.365886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-90878e36-05c7-450a-884e-bf40c66d9d3b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.211899 Jun 23 08:21:01.366455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 55/121] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:01 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:01.376547 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a229b0c1-344b-4317-a95a-fb61980005ee tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:01.377590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a229b0c1-344b-4317-a95a-fb61980005ee tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:01.384344 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a229b0c1-344b-4317-a95a-fb61980005ee tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:01.384801 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a229b0c1-344b-4317-a95a-fb61980005ee tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:01.385573 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a229b0c1-344b-4317-a95a-fb61980005ee tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:01.386574 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a229b0c1-344b-4317-a95a-fb61980005ee tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:01.387781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-45046699-5612-4223-90b4-89b858ae1eae tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:01.396200 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-45046699-5612-4223-90b4-89b858ae1eae tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.199769 Jun 23 08:21:01.405635 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 67/122] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:01 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:01.521744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a229b0c1-344b-4317-a95a-fb61980005ee tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:01.529813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a229b0c1-344b-4317-a95a-fb61980005ee tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.159785 Jun 23 08:21:01.530418 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 56/123] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:01 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:02.155762 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1f96919a-ec0d-4d97-9b86-8a56969c0bc2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:02.156421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1f96919a-ec0d-4d97-9b86-8a56969c0bc2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:02.162558 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1f96919a-ec0d-4d97-9b86-8a56969c0bc2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:02.163005 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1f96919a-ec0d-4d97-9b86-8a56969c0bc2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:02.163879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1f96919a-ec0d-4d97-9b86-8a56969c0bc2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:02.164314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1f96919a-ec0d-4d97-9b86-8a56969c0bc2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:02.300781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1f96919a-ec0d-4d97-9b86-8a56969c0bc2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:02.312356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1f96919a-ec0d-4d97-9b86-8a56969c0bc2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.160374 Jun 23 08:21:02.313179 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 68/124] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:02 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:02.383521 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:02.384118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:02.390813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:02.391264 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:02.392071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:02.392503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:02.413850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-13334646-d6d1-48c8-a1f8-1a003174e383 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:02.414498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-13334646-d6d1-48c8-a1f8-1a003174e383 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:02.425300 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13334646-d6d1-48c8-a1f8-1a003174e383 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:02.425715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13334646-d6d1-48c8-a1f8-1a003174e383 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:02.426521 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13334646-d6d1-48c8-a1f8-1a003174e383 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:02.427045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13334646-d6d1-48c8-a1f8-1a003174e383 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:02.563565 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:02.579168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:02.580872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:02.581987 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2f5a2f0c-0d4f-4a98-b149-14e50f286760 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.202426 Jun 23 08:21:02.582553 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 57/125] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:02 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:02.587271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bcbf5a99-abb7-4a54-9128-6026f18377d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:02.587880 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bcbf5a99-abb7-4a54-9128-6026f18377d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:02.595607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bcbf5a99-abb7-4a54-9128-6026f18377d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:02.596053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bcbf5a99-abb7-4a54-9128-6026f18377d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:02.596815 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bcbf5a99-abb7-4a54-9128-6026f18377d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:02.597247 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bcbf5a99-abb7-4a54-9128-6026f18377d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:02.626186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-13334646-d6d1-48c8-a1f8-1a003174e383 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:02.645117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-13334646-d6d1-48c8-a1f8-1a003174e383 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.235199 Jun 23 08:21:02.645700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 69/126] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:02 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:02.733089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bcbf5a99-abb7-4a54-9128-6026f18377d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:02.740486 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bcbf5a99-abb7-4a54-9128-6026f18377d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.156837 Jun 23 08:21:02.741049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 58/127] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:02 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:03.335648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2dee1e2d-e823-41ab-81a3-480ecdf2130d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:03.336239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2dee1e2d-e823-41ab-81a3-480ecdf2130d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:03.348470 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2dee1e2d-e823-41ab-81a3-480ecdf2130d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:03.349009 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2dee1e2d-e823-41ab-81a3-480ecdf2130d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:03.349862 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2dee1e2d-e823-41ab-81a3-480ecdf2130d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:03.350387 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2dee1e2d-e823-41ab-81a3-480ecdf2130d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:03.487198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2dee1e2d-e823-41ab-81a3-480ecdf2130d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:03.495540 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2dee1e2d-e823-41ab-81a3-480ecdf2130d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.163535 Jun 23 08:21:03.496044 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 70/128] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:03 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:03.600292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:03.600917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:03.607363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:03.607786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:03.608555 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:03.609291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:03.663317 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-38c44670-81a1-4f29-a85e-9ebd8268b7d9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:03.663920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-38c44670-81a1-4f29-a85e-9ebd8268b7d9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:03.670063 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-38c44670-81a1-4f29-a85e-9ebd8268b7d9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:03.670685 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-38c44670-81a1-4f29-a85e-9ebd8268b7d9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:03.671662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-38c44670-81a1-4f29-a85e-9ebd8268b7d9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:03.672254 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-38c44670-81a1-4f29-a85e-9ebd8268b7d9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:03.801627 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:03.813490 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:03.819644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-38c44670-81a1-4f29-a85e-9ebd8268b7d9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:03.832238 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:03.835545 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1a7be166-5a90-49ff-b807-bc4fbe05fe64 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.239125 Jun 23 08:21:03.839026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 59/129] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:03 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:03.846127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-35d530c2-0e70-4f91-b25e-c1797d241e80 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:03.849453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-38c44670-81a1-4f29-a85e-9ebd8268b7d9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.190005 Jun 23 08:21:03.850042 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 71/130] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:03 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:03.850895 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-35d530c2-0e70-4f91-b25e-c1797d241e80 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:03.857511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-35d530c2-0e70-4f91-b25e-c1797d241e80 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:03.858287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-35d530c2-0e70-4f91-b25e-c1797d241e80 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:03.859185 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-35d530c2-0e70-4f91-b25e-c1797d241e80 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:03.859795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-35d530c2-0e70-4f91-b25e-c1797d241e80 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:04.046978 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-35d530c2-0e70-4f91-b25e-c1797d241e80 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:04.056965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-35d530c2-0e70-4f91-b25e-c1797d241e80 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.214673 Jun 23 08:21:04.057819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 60/131] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:03 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:04.513722 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4cc55d24-9b29-4dac-91f1-36939f4cfd2e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:04.514579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4cc55d24-9b29-4dac-91f1-36939f4cfd2e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:04.520991 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cc55d24-9b29-4dac-91f1-36939f4cfd2e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:04.521431 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cc55d24-9b29-4dac-91f1-36939f4cfd2e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:04.522314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cc55d24-9b29-4dac-91f1-36939f4cfd2e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:04.522757 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cc55d24-9b29-4dac-91f1-36939f4cfd2e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:04.653413 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4cc55d24-9b29-4dac-91f1-36939f4cfd2e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:04.661065 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4cc55d24-9b29-4dac-91f1-36939f4cfd2e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.151342 Jun 23 08:21:04.661640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 72/132] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:04 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:04.862078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:04.862810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:04.865947 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-dc2fc5d9-ac19-4c7a-a99a-605152371d9c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:04.866566 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-dc2fc5d9-ac19-4c7a-a99a-605152371d9c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:04.869248 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:04.869902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:04.870668 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:04.871121 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:04.873400 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc2fc5d9-ac19-4c7a-a99a-605152371d9c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:04.873848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc2fc5d9-ac19-4c7a-a99a-605152371d9c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:04.874613 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc2fc5d9-ac19-4c7a-a99a-605152371d9c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:04.875048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc2fc5d9-ac19-4c7a-a99a-605152371d9c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:05.018346 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:05.027436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:05.029220 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:05.032713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dc2fc5d9-ac19-4c7a-a99a-605152371d9c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:05.040363 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-dc2fc5d9-ac19-4c7a-a99a-605152371d9c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.178212 Jun 23 08:21:05.041433 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-84c33ace-7bb3-4ace-a672-010374cc157c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.189692 Jun 23 08:21:05.042104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 61/134] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:04 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:05.042255 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 73/133] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:04 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:05.074401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-678a2a17-3a62-4506-9348-3c4c39990247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:05.074902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-678a2a17-3a62-4506-9348-3c4c39990247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:05.081605 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-678a2a17-3a62-4506-9348-3c4c39990247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:05.082042 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-678a2a17-3a62-4506-9348-3c4c39990247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:05.082788 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-678a2a17-3a62-4506-9348-3c4c39990247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:05.083244 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-678a2a17-3a62-4506-9348-3c4c39990247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:05.214409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-678a2a17-3a62-4506-9348-3c4c39990247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:05.223778 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-678a2a17-3a62-4506-9348-3c4c39990247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.153833 Jun 23 08:21:05.224357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 62/135] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:05 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:05.679285 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f393b4f9-7319-44c5-a480-414643f66e6c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:05.679897 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f393b4f9-7319-44c5-a480-414643f66e6c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:05.686595 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f393b4f9-7319-44c5-a480-414643f66e6c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:05.687032 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f393b4f9-7319-44c5-a480-414643f66e6c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:05.687850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f393b4f9-7319-44c5-a480-414643f66e6c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:05.688284 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f393b4f9-7319-44c5-a480-414643f66e6c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:05.846451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f393b4f9-7319-44c5-a480-414643f66e6c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:05.855165 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f393b4f9-7319-44c5-a480-414643f66e6c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.180901 Jun 23 08:21:05.856050 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 74/136] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:05 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:05.980093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-c89bb438-1f3e-42ed-aef5-e6bac47420fb req-15958e6a-8fec-4e38-80ca-7921779d3a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2adbdb87-cc07-4747-9533-ed6cc8926aee", "name": "network-vif-plugged", "status": "completed", "tag": "09f817fd-0504-4e71-9bac-fe9a86e146b7"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:05.988402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-c89bb438-1f3e-42ed-aef5-e6bac47420fb req-15958e6a-8fec-4e38-80ca-7921779d3a65 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:05.988835 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-c89bb438-1f3e-42ed-aef5-e6bac47420fb req-15958e6a-8fec-4e38-80ca-7921779d3a65 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:06.001117 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-c89bb438-1f3e-42ed-aef5-e6bac47420fb req-15958e6a-8fec-4e38-80ca-7921779d3a65 service nova] Creating event network-vif-plugged:09f817fd-0504-4e71-9bac-fe9a86e146b7 for instance 2adbdb87-cc07-4747-9533-ed6cc8926aee on hv-cinder-84721 Jun 23 08:21:06.006375 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-c89bb438-1f3e-42ed-aef5-e6bac47420fb req-15958e6a-8fec-4e38-80ca-7921779d3a65 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165840 Jun 23 08:21:06.006999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 63/137] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:06.057372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cb564fc4-b995-4e98-be6b-87354be87a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:06.058146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cb564fc4-b995-4e98-be6b-87354be87a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:06.059703 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:06.060729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:06.064343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cb564fc4-b995-4e98-be6b-87354be87a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:06.064789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cb564fc4-b995-4e98-be6b-87354be87a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:06.065543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cb564fc4-b995-4e98-be6b-87354be87a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:06.065973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cb564fc4-b995-4e98-be6b-87354be87a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:06.067714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:06.068229 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:06.069054 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:06.069579 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:06.226339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cb564fc4-b995-4e98-be6b-87354be87a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:06.237711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cb564fc4-b995-4e98-be6b-87354be87a20 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.184305 Jun 23 08:21:06.238511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 75/138] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:06 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:06.245040 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:06.250674 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8a623e73-0fcb-4a70-aebc-7b3fab6ad595 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:06.251304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8a623e73-0fcb-4a70-aebc-7b3fab6ad595 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:06.256049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:06.257796 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:06.258909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3f3380da-6bc1-4c1a-9f04-e371a95db174 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.203355 Jun 23 08:21:06.259505 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 64/139] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:06 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:06.264458 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8a623e73-0fcb-4a70-aebc-7b3fab6ad595 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:06.264996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8a623e73-0fcb-4a70-aebc-7b3fab6ad595 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:06.265855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8a623e73-0fcb-4a70-aebc-7b3fab6ad595 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:06.266438 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8a623e73-0fcb-4a70-aebc-7b3fab6ad595 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:06.270861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:06.449120 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8a623e73-0fcb-4a70-aebc-7b3fab6ad595 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:06.457329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8a623e73-0fcb-4a70-aebc-7b3fab6ad595 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.217659 Jun 23 08:21:06.458479 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 76/140] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:06 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:06.873659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-36e39d59-f509-4194-8d46-211e36d109ec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:06.874518 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-36e39d59-f509-4194-8d46-211e36d109ec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:06.881553 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36e39d59-f509-4194-8d46-211e36d109ec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:06.882798 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36e39d59-f509-4194-8d46-211e36d109ec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:06.883710 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36e39d59-f509-4194-8d46-211e36d109ec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:06.884312 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36e39d59-f509-4194-8d46-211e36d109ec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:07.061070 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-36e39d59-f509-4194-8d46-211e36d109ec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:07.068722 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-36e39d59-f509-4194-8d46-211e36d109ec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.200555 Jun 23 08:21:07.069288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 65/141] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:06 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:07.254874 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-dd517646-f689-446c-8112-5699df2483a9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:07.255567 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-dd517646-f689-446c-8112-5699df2483a9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:07.262352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd517646-f689-446c-8112-5699df2483a9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:07.262884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd517646-f689-446c-8112-5699df2483a9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:07.264027 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd517646-f689-446c-8112-5699df2483a9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:07.264382 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd517646-f689-446c-8112-5699df2483a9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:07.277984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:07.278712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:07.285240 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:07.285922 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:07.286682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:07.287108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:07.307416 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:07.430849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dd517646-f689-446c-8112-5699df2483a9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:07.440234 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-dd517646-f689-446c-8112-5699df2483a9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.189685 Jun 23 08:21:07.440976 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 77/142] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:07 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:07.468854 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:07.475913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8dc01b0a-7750-4ce2-a05b-d4e923f9bdac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:07.477115 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8dc01b0a-7750-4ce2-a05b-d4e923f9bdac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:07.488838 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:07.488838 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:07.489116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8dc01b0a-7750-4ce2-a05b-d4e923f9bdac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:07.489116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8dc01b0a-7750-4ce2-a05b-d4e923f9bdac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:07.489116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8dc01b0a-7750-4ce2-a05b-d4e923f9bdac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:07.489116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8dc01b0a-7750-4ce2-a05b-d4e923f9bdac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:07.489448 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-651a9ee8-33de-43f3-9a0c-587a9df235cb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.213140 Jun 23 08:21:07.504786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 66/143] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:07 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:07.684479 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8dc01b0a-7750-4ce2-a05b-d4e923f9bdac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:07.693308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8dc01b0a-7750-4ce2-a05b-d4e923f9bdac tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.222531 Jun 23 08:21:07.694634 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 78/144] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:07 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:08.022685 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-105b6f49-bdb8-4607-b22e-f0725962dc44 req-b87deddc-d0a4-4141-9213-d1988f051a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621b2677-57b0-46a1-a540-efec39d1b018", "name": "network-vif-plugged", "status": "completed", "tag": "ad0fc4d0-bce3-4944-97da-42c68812609c"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:08.040543 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-105b6f49-bdb8-4607-b22e-f0725962dc44 req-b87deddc-d0a4-4141-9213-d1988f051a47 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.044827 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-105b6f49-bdb8-4607-b22e-f0725962dc44 req-b87deddc-d0a4-4141-9213-d1988f051a47 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.057696 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-105b6f49-bdb8-4607-b22e-f0725962dc44 req-b87deddc-d0a4-4141-9213-d1988f051a47 service nova] Creating event network-vif-plugged:ad0fc4d0-bce3-4944-97da-42c68812609c for instance 621b2677-57b0-46a1-a540-efec39d1b018 on hv-cinder-84721 Jun 23 08:21:08.063020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-105b6f49-bdb8-4607-b22e-f0725962dc44 req-b87deddc-d0a4-4141-9213-d1988f051a47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044086 Jun 23 08:21:08.063948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 67/145] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:08.086114 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-53eecc64-7d11-4b54-abe2-5b6185ec8ea3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:08.087623 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-53eecc64-7d11-4b54-abe2-5b6185ec8ea3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:08.095018 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53eecc64-7d11-4b54-abe2-5b6185ec8ea3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.095497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53eecc64-7d11-4b54-abe2-5b6185ec8ea3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.096288 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53eecc64-7d11-4b54-abe2-5b6185ec8ea3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.096711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53eecc64-7d11-4b54-abe2-5b6185ec8ea3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.314243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-53eecc64-7d11-4b54-abe2-5b6185ec8ea3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:08.327380 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-53eecc64-7d11-4b54-abe2-5b6185ec8ea3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.245377 Jun 23 08:21:08.328703 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 79/146] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:08 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:08.458375 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-12c5fd09-c7a1-41c3-9565-6f1052bbef2c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:08.459228 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-12c5fd09-c7a1-41c3-9565-6f1052bbef2c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:08.465785 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12c5fd09-c7a1-41c3-9565-6f1052bbef2c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.466254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12c5fd09-c7a1-41c3-9565-6f1052bbef2c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.472035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12c5fd09-c7a1-41c3-9565-6f1052bbef2c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.472688 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12c5fd09-c7a1-41c3-9565-6f1052bbef2c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.515706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:08.516390 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:08.534337 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.539939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.540884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.541526 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.708623 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-12c5fd09-c7a1-41c3-9565-6f1052bbef2c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:08.717865 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-12c5fd09-c7a1-41c3-9565-6f1052bbef2c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.263595 Jun 23 08:21:08.718914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 68/147] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:08 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:08.731772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bcf0c877-fcfb-493b-bfb0-685998438a72 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:08.732824 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bcf0c877-fcfb-493b-bfb0-685998438a72 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:08.740102 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bcf0c877-fcfb-493b-bfb0-685998438a72 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.740722 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bcf0c877-fcfb-493b-bfb0-685998438a72 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.741616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bcf0c877-fcfb-493b-bfb0-685998438a72 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:08.742178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bcf0c877-fcfb-493b-bfb0-685998438a72 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:08.776152 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:08.785086 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:08.786958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:08.788125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-234cc830-f4a3-44cc-bbfb-ccb4d8d21cae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.278127 Jun 23 08:21:08.788906 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 80/148] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:08 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:08.908263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bcf0c877-fcfb-493b-bfb0-685998438a72 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:08.917230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bcf0c877-fcfb-493b-bfb0-685998438a72 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.196687 Jun 23 08:21:08.927982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 69/149] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:08 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:09.352873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-72f8d5eb-3933-47ae-a8bb-beeb8dee7d4b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:09.354655 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-72f8d5eb-3933-47ae-a8bb-beeb8dee7d4b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:09.369639 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-72f8d5eb-3933-47ae-a8bb-beeb8dee7d4b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:09.370080 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-72f8d5eb-3933-47ae-a8bb-beeb8dee7d4b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:09.371713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-72f8d5eb-3933-47ae-a8bb-beeb8dee7d4b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:09.372593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-72f8d5eb-3933-47ae-a8bb-beeb8dee7d4b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:09.553520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-72f8d5eb-3933-47ae-a8bb-beeb8dee7d4b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:09.583031 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-72f8d5eb-3933-47ae-a8bb-beeb8dee7d4b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.238850 Jun 23 08:21:09.585242 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 81/150] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:09 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:09.740597 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-52c29c4e-b996-4d93-ae1c-1f88868bb45a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:09.741937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-52c29c4e-b996-4d93-ae1c-1f88868bb45a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:09.750905 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-52c29c4e-b996-4d93-ae1c-1f88868bb45a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:09.751764 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-52c29c4e-b996-4d93-ae1c-1f88868bb45a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:09.752961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-52c29c4e-b996-4d93-ae1c-1f88868bb45a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:09.753613 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-52c29c4e-b996-4d93-ae1c-1f88868bb45a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:09.816045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:09.819828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:09.837052 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:09.845061 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:09.846047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:09.847282 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:10.099401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-52c29c4e-b996-4d93-ae1c-1f88868bb45a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:10.111125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-52c29c4e-b996-4d93-ae1c-1f88868bb45a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.376124 Jun 23 08:21:10.131412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 70/151] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:09 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:10.136383 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-01f82739-4675-43a3-8e44-d23fd28cf6a8 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:10.137046 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-01f82739-4675-43a3-8e44-d23fd28cf6a8 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:10.147575 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-01f82739-4675-43a3-8e44-d23fd28cf6a8 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:10.148168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-01f82739-4675-43a3-8e44-d23fd28cf6a8 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:10.149837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-01f82739-4675-43a3-8e44-d23fd28cf6a8 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:10.150748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-01f82739-4675-43a3-8e44-d23fd28cf6a8 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:10.157571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:10.168647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:10.170429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:10.183301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-68a24cde-a546-4844-98bc-1e37fa1c6683 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.368848 Jun 23 08:21:10.184268 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 82/152] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:09 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:10.189303 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-94503add-2ff3-4356-9d5a-5562564c8c78 req-8bb68b8f-0798-468b-ad11-0b2e9819251b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba31757-3f23-4c93-8016-2448fa5510b9", "name": "network-vif-plugged", "status": "completed", "tag": "0203a36b-327e-4646-9fe0-705599369659"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:10.202067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-94503add-2ff3-4356-9d5a-5562564c8c78 req-8bb68b8f-0798-468b-ad11-0b2e9819251b service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:10.202504 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-94503add-2ff3-4356-9d5a-5562564c8c78 req-8bb68b8f-0798-468b-ad11-0b2e9819251b service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:10.216049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-94503add-2ff3-4356-9d5a-5562564c8c78 req-8bb68b8f-0798-468b-ad11-0b2e9819251b service nova] Creating event network-vif-plugged:0203a36b-327e-4646-9fe0-705599369659 for instance 8ba31757-3f23-4c93-8016-2448fa5510b9 on hv-cinder-84721 Jun 23 08:21:10.223769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-94503add-2ff3-4356-9d5a-5562564c8c78 req-8bb68b8f-0798-468b-ad11-0b2e9819251b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037913 Jun 23 08:21:10.225290 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 83/153] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:10.324533 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-01f82739-4675-43a3-8e44-d23fd28cf6a8 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:10.333632 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-01f82739-4675-43a3-8e44-d23fd28cf6a8 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.207658 Jun 23 08:21:10.334281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 71/154] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:10 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:10.603634 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5bdd3083-ae33-4388-98a6-571ab80815d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:10.604954 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5bdd3083-ae33-4388-98a6-571ab80815d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:10.612011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5bdd3083-ae33-4388-98a6-571ab80815d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:10.612532 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5bdd3083-ae33-4388-98a6-571ab80815d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:10.613635 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5bdd3083-ae33-4388-98a6-571ab80815d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:10.614425 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5bdd3083-ae33-4388-98a6-571ab80815d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:10.797717 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5bdd3083-ae33-4388-98a6-571ab80815d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:10.809158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5bdd3083-ae33-4388-98a6-571ab80815d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.209784 Jun 23 08:21:10.810172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 84/155] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:10 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:11.130460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7a3ab464-0bb1-46b0-97fb-b9a572f8d162 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:11.131111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7a3ab464-0bb1-46b0-97fb-b9a572f8d162 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:11.138216 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a3ab464-0bb1-46b0-97fb-b9a572f8d162 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:11.138711 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a3ab464-0bb1-46b0-97fb-b9a572f8d162 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:11.139622 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a3ab464-0bb1-46b0-97fb-b9a572f8d162 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:11.140139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a3ab464-0bb1-46b0-97fb-b9a572f8d162 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:11.203284 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:11.203284 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:11.209631 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:11.210314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:11.211677 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:11.212839 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:11.321363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7a3ab464-0bb1-46b0-97fb-b9a572f8d162 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:11.331243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7a3ab464-0bb1-46b0-97fb-b9a572f8d162 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.205828 Jun 23 08:21:11.341323 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 72/156] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:11 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:11.353085 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bf358978-8ed9-43aa-9153-8265a65f57d7 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:11.354180 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bf358978-8ed9-43aa-9153-8265a65f57d7 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:11.363257 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf358978-8ed9-43aa-9153-8265a65f57d7 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:11.363953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf358978-8ed9-43aa-9153-8265a65f57d7 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:11.365637 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf358978-8ed9-43aa-9153-8265a65f57d7 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:11.366301 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf358978-8ed9-43aa-9153-8265a65f57d7 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:11.470751 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:11.482647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:11.484922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:11.486958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-921bf635-62b6-4739-b682-bfe07a3694df tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.288902 Jun 23 08:21:11.487762 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 85/157] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:11 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:11.632138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bf358978-8ed9-43aa-9153-8265a65f57d7 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:11.644008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bf358978-8ed9-43aa-9153-8265a65f57d7 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.297084 Jun 23 08:21:11.645449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 73/158] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:11 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:11.825974 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b9279eeb-e98e-4ea2-9f88-cd9754b3a583 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:11.826683 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b9279eeb-e98e-4ea2-9f88-cd9754b3a583 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:11.833508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b9279eeb-e98e-4ea2-9f88-cd9754b3a583 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:11.833947 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b9279eeb-e98e-4ea2-9f88-cd9754b3a583 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:11.834709 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b9279eeb-e98e-4ea2-9f88-cd9754b3a583 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:11.835135 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b9279eeb-e98e-4ea2-9f88-cd9754b3a583 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:11.969705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b9279eeb-e98e-4ea2-9f88-cd9754b3a583 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:11.977585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b9279eeb-e98e-4ea2-9f88-cd9754b3a583 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.155509 Jun 23 08:21:11.987682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 86/159] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:11 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:12.347616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e011c7de-0480-4260-965b-2f284f81d9c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:12.348213 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e011c7de-0480-4260-965b-2f284f81d9c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:12.354553 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e011c7de-0480-4260-965b-2f284f81d9c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:12.354996 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e011c7de-0480-4260-965b-2f284f81d9c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:12.355787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e011c7de-0480-4260-965b-2f284f81d9c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:12.356216 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e011c7de-0480-4260-965b-2f284f81d9c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:12.508006 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:12.509727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:12.530723 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:12.531172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:12.531990 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:12.532422 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:12.572057 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e011c7de-0480-4260-965b-2f284f81d9c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:12.581098 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e011c7de-0480-4260-965b-2f284f81d9c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.237506 Jun 23 08:21:12.581650 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 74/160] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:12 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:12.662328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7dcaad8b-146f-49d7-a841-f57c94142dae tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:12.663540 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7dcaad8b-146f-49d7-a841-f57c94142dae tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:12.670353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7dcaad8b-146f-49d7-a841-f57c94142dae tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:12.670536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7dcaad8b-146f-49d7-a841-f57c94142dae tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:12.671496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7dcaad8b-146f-49d7-a841-f57c94142dae tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:12.672087 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7dcaad8b-146f-49d7-a841-f57c94142dae tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:12.674318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:12.684103 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:12.685924 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:12.687290 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b02996ce-ad35-42ea-aba2-306165bce732 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.185110 Jun 23 08:21:12.688615 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 87/161] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:12 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:12.844242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7dcaad8b-146f-49d7-a841-f57c94142dae tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:12.851797 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7dcaad8b-146f-49d7-a841-f57c94142dae tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.193896 Jun 23 08:21:12.852390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 75/162] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:12 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:12.994329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-faf6ea96-b226-4147-a68e-b2a1dde7b75d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:12.994876 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-faf6ea96-b226-4147-a68e-b2a1dde7b75d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:13.003245 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-faf6ea96-b226-4147-a68e-b2a1dde7b75d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:13.003771 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-faf6ea96-b226-4147-a68e-b2a1dde7b75d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:13.004689 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-faf6ea96-b226-4147-a68e-b2a1dde7b75d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:13.005123 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-faf6ea96-b226-4147-a68e-b2a1dde7b75d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:13.160545 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-faf6ea96-b226-4147-a68e-b2a1dde7b75d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:13.169325 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-faf6ea96-b226-4147-a68e-b2a1dde7b75d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.179019 Jun 23 08:21:13.169902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 88/163] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:12 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:13.598411 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-82b4b86d-9043-4acf-8492-69ac3028ada3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:13.599013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-82b4b86d-9043-4acf-8492-69ac3028ada3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:13.601059 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=98 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:13.608067 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-82b4b86d-9043-4acf-8492-69ac3028ada3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:13.608513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-82b4b86d-9043-4acf-8492-69ac3028ada3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:13.609291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-82b4b86d-9043-4acf-8492-69ac3028ada3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:13.609714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-82b4b86d-9043-4acf-8492-69ac3028ada3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:13.707307 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:13.708762 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:13.718323 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:13.719121 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:13.720402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:13.721323 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:13.748781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-82b4b86d-9043-4acf-8492-69ac3028ada3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:13.765939 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-82b4b86d-9043-4acf-8492-69ac3028ada3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.171517 Jun 23 08:21:13.766482 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 76/164] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:13 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:13.870099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c37ba5c6-9b52-4eaa-80e8-9b409dfdda3a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:13.870662 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c37ba5c6-9b52-4eaa-80e8-9b409dfdda3a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:13.877390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c37ba5c6-9b52-4eaa-80e8-9b409dfdda3a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:13.877873 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c37ba5c6-9b52-4eaa-80e8-9b409dfdda3a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:13.878631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c37ba5c6-9b52-4eaa-80e8-9b409dfdda3a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:13.879074 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c37ba5c6-9b52-4eaa-80e8-9b409dfdda3a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:14.012335 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c37ba5c6-9b52-4eaa-80e8-9b409dfdda3a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:14.020603 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c37ba5c6-9b52-4eaa-80e8-9b409dfdda3a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.155569 Jun 23 08:21:14.021497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 77/165] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:13 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:14.147650 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:14.155612 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:14.157351 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:14.158567 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-16d9499d-8ddc-475b-895e-614f4e5d2591 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.456286 Jun 23 08:21:14.159118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 89/166] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:13 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:14.185881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cc0611e9-e802-4d18-acb1-2a1fc38e73ad tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:14.186482 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cc0611e9-e802-4d18-acb1-2a1fc38e73ad tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:14.192649 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cc0611e9-e802-4d18-acb1-2a1fc38e73ad tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:14.193298 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cc0611e9-e802-4d18-acb1-2a1fc38e73ad tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:14.194052 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cc0611e9-e802-4d18-acb1-2a1fc38e73ad tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:14.194469 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cc0611e9-e802-4d18-acb1-2a1fc38e73ad tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:14.358304 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cc0611e9-e802-4d18-acb1-2a1fc38e73ad tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:14.365902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cc0611e9-e802-4d18-acb1-2a1fc38e73ad tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.183884 Jun 23 08:21:14.366579 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 78/167] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:14 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:14.783534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-00df6375-8c2d-4fb7-b46c-70c275c059fc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:14.784325 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-00df6375-8c2d-4fb7-b46c-70c275c059fc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:14.791931 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-00df6375-8c2d-4fb7-b46c-70c275c059fc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:14.792392 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-00df6375-8c2d-4fb7-b46c-70c275c059fc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:14.793171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-00df6375-8c2d-4fb7-b46c-70c275c059fc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:14.793620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-00df6375-8c2d-4fb7-b46c-70c275c059fc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:14.940317 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-00df6375-8c2d-4fb7-b46c-70c275c059fc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:14.948240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-00df6375-8c2d-4fb7-b46c-70c275c059fc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.169875 Jun 23 08:21:14.949257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 90/168] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:14 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:15.039193 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ac1a7b46-9365-40d5-bdf0-abf80bf0875e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:15.040087 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ac1a7b46-9365-40d5-bdf0-abf80bf0875e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:15.046744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ac1a7b46-9365-40d5-bdf0-abf80bf0875e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.047179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ac1a7b46-9365-40d5-bdf0-abf80bf0875e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:15.047950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ac1a7b46-9365-40d5-bdf0-abf80bf0875e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.048374 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ac1a7b46-9365-40d5-bdf0-abf80bf0875e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:15.180328 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:15.181468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:15.188884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.189321 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:15.190103 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.190523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:15.195373 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ac1a7b46-9365-40d5-bdf0-abf80bf0875e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:15.203455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ac1a7b46-9365-40d5-bdf0-abf80bf0875e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.168437 Jun 23 08:21:15.204034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 79/169] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:15 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:15.323617 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:15.331930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:15.333406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:15.334489 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-31b050a3-bc4d-487b-aedd-c3183c088ece tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.160924 Jun 23 08:21:15.335039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 91/170] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:15 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:15.383458 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3bc0577b-c374-4e28-b51d-ef7a0aa135b8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:15.384078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3bc0577b-c374-4e28-b51d-ef7a0aa135b8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:15.390479 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3bc0577b-c374-4e28-b51d-ef7a0aa135b8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.390960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3bc0577b-c374-4e28-b51d-ef7a0aa135b8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:15.391736 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3bc0577b-c374-4e28-b51d-ef7a0aa135b8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.392160 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3bc0577b-c374-4e28-b51d-ef7a0aa135b8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:15.533311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3bc0577b-c374-4e28-b51d-ef7a0aa135b8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:15.541577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3bc0577b-c374-4e28-b51d-ef7a0aa135b8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.162227 Jun 23 08:21:15.542135 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 80/171] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:15 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:15.670765 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-0edb8ef7-0549-40a0-8112-0515ebfaf107 req-d51b1e0e-53c1-4227-99c2-9475b0c1fce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795dfab2-6368-40d4-bf89-95f37e857ceb", "name": "network-vif-plugged", "status": "completed", "tag": "9cdd8d49-4a4d-48e0-bf8b-c4d771ada3d9"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:15.679130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-0edb8ef7-0549-40a0-8112-0515ebfaf107 req-d51b1e0e-53c1-4227-99c2-9475b0c1fce1 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.679678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-0edb8ef7-0549-40a0-8112-0515ebfaf107 req-d51b1e0e-53c1-4227-99c2-9475b0c1fce1 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:15.691355 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-0edb8ef7-0549-40a0-8112-0515ebfaf107 req-d51b1e0e-53c1-4227-99c2-9475b0c1fce1 service nova] Creating event network-vif-plugged:9cdd8d49-4a4d-48e0-bf8b-c4d771ada3d9 for instance 795dfab2-6368-40d4-bf89-95f37e857ceb on hv-cinder-84721 Jun 23 08:21:15.696565 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-0edb8ef7-0549-40a0-8112-0515ebfaf107 req-d51b1e0e-53c1-4227-99c2-9475b0c1fce1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029626 Jun 23 08:21:15.697464 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 92/172] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:15.965895 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4b243dc5-42a2-4765-9186-141bddf4890f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:15.966493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4b243dc5-42a2-4765-9186-141bddf4890f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:15.973657 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b243dc5-42a2-4765-9186-141bddf4890f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.974124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b243dc5-42a2-4765-9186-141bddf4890f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:15.974877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b243dc5-42a2-4765-9186-141bddf4890f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:15.975301 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b243dc5-42a2-4765-9186-141bddf4890f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:16.225393 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e6c5d080-8924-4c57-bfa1-28a6aa010aed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:16.227406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e6c5d080-8924-4c57-bfa1-28a6aa010aed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:16.233816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:16.250712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e6c5d080-8924-4c57-bfa1-28a6aa010aed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:16.251804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e6c5d080-8924-4c57-bfa1-28a6aa010aed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:16.252587 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e6c5d080-8924-4c57-bfa1-28a6aa010aed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:16.253017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e6c5d080-8924-4c57-bfa1-28a6aa010aed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:16.539711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e6c5d080-8924-4c57-bfa1-28a6aa010aed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:16.550845 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e6c5d080-8924-4c57-bfa1-28a6aa010aed tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.333978 Jun 23 08:21:16.561023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 93/173] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:16 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:16.566440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:16.567035 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:16.572956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:16.573435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:16.574394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:16.574823 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:16.579138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:16.643653 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4b243dc5-42a2-4765-9186-141bddf4890f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:16.652983 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4b243dc5-42a2-4765-9186-141bddf4890f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.690958 Jun 23 08:21:16.653859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 81/174] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:15 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:16.659241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-784b482e-e705-4211-94b4-0d6c0feeb293 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:16.659963 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-784b482e-e705-4211-94b4-0d6c0feeb293 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:16.665719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-784b482e-e705-4211-94b4-0d6c0feeb293 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:16.666154 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-784b482e-e705-4211-94b4-0d6c0feeb293 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:16.666961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-784b482e-e705-4211-94b4-0d6c0feeb293 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:16.667343 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-784b482e-e705-4211-94b4-0d6c0feeb293 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:16.712856 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:16.721595 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:16.723887 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:16.725127 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f444350b-f20d-4be6-af44-102bfd7a8d55 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.162577 Jun 23 08:21:16.725894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 94/175] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:16 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:16.945851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-784b482e-e705-4211-94b4-0d6c0feeb293 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:16.954168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-784b482e-e705-4211-94b4-0d6c0feeb293 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.298492 Jun 23 08:21:16.954744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 82/176] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:16 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:17.568591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a60315c7-aa7a-4cff-a823-09db7ed9783f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:17.569164 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a60315c7-aa7a-4cff-a823-09db7ed9783f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:17.579318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a60315c7-aa7a-4cff-a823-09db7ed9783f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:17.579318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a60315c7-aa7a-4cff-a823-09db7ed9783f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:17.579318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a60315c7-aa7a-4cff-a823-09db7ed9783f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:17.579318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a60315c7-aa7a-4cff-a823-09db7ed9783f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:17.669759 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0c00152f-8d6a-4242-a260-cdd8a5719572 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:17.670551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0c00152f-8d6a-4242-a260-cdd8a5719572 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:17.676907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c00152f-8d6a-4242-a260-cdd8a5719572 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:17.677342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c00152f-8d6a-4242-a260-cdd8a5719572 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:17.678078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c00152f-8d6a-4242-a260-cdd8a5719572 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:17.678473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c00152f-8d6a-4242-a260-cdd8a5719572 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:17.713101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a60315c7-aa7a-4cff-a823-09db7ed9783f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:17.721443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a60315c7-aa7a-4cff-a823-09db7ed9783f tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.156873 Jun 23 08:21:17.722055 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 95/177] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:17 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:17.743896 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:17.744508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:17.751166 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:17.751627 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:17.752392 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:17.752892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:17.817235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0c00152f-8d6a-4242-a260-cdd8a5719572 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:17.820628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:17.824940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0c00152f-8d6a-4242-a260-cdd8a5719572 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.158956 Jun 23 08:21:17.825517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 83/178] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:17 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:17.888249 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:17.896758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:17.898242 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:17.899372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c6333b68-f9d0-4d6d-baab-c5e41108069c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.159615 Jun 23 08:21:17.899945 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 96/179] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:17 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:17.973281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d858f0dc-2721-49a3-a526-ff14bf5ae2ee tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:17.974023 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d858f0dc-2721-49a3-a526-ff14bf5ae2ee tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:17.982129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d858f0dc-2721-49a3-a526-ff14bf5ae2ee tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:17.982830 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d858f0dc-2721-49a3-a526-ff14bf5ae2ee tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:17.983643 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d858f0dc-2721-49a3-a526-ff14bf5ae2ee tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:17.984072 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d858f0dc-2721-49a3-a526-ff14bf5ae2ee tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:18.135646 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d858f0dc-2721-49a3-a526-ff14bf5ae2ee tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:18.143960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d858f0dc-2721-49a3-a526-ff14bf5ae2ee tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.176411 Jun 23 08:21:18.144522 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 84/180] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:17 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:18.738341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-66e01ee4-c6ce-4e90-97df-1b5239222247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:18.739281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-66e01ee4-c6ce-4e90-97df-1b5239222247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:18.745727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-66e01ee4-c6ce-4e90-97df-1b5239222247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:18.746176 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-66e01ee4-c6ce-4e90-97df-1b5239222247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:18.746928 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-66e01ee4-c6ce-4e90-97df-1b5239222247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:18.747496 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-66e01ee4-c6ce-4e90-97df-1b5239222247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:18.841850 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-caca09ba-7743-4305-834b-01376617e04d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:18.842541 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-caca09ba-7743-4305-834b-01376617e04d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:18.848746 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-caca09ba-7743-4305-834b-01376617e04d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:18.849262 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-caca09ba-7743-4305-834b-01376617e04d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:18.850076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-caca09ba-7743-4305-834b-01376617e04d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:18.850581 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-caca09ba-7743-4305-834b-01376617e04d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:18.889190 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-66e01ee4-c6ce-4e90-97df-1b5239222247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:18.897170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-66e01ee4-c6ce-4e90-97df-1b5239222247 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.162833 Jun 23 08:21:18.897748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 97/181] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:18 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:18.917360 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:18.917948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:18.924513 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:18.924945 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:18.925721 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:18.926139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:18.984531 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-caca09ba-7743-4305-834b-01376617e04d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:18.992420 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-caca09ba-7743-4305-834b-01376617e04d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.154364 Jun 23 08:21:18.993000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 85/182] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:18 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:19.061741 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:19.070088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:19.071584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:19.072639 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-67898c10-5b52-4b4d-9935-d8fe29a9e20f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.159154 Jun 23 08:21:19.073193 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 98/183] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:18 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:19.164951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7b8047bd-d5fc-4afe-a0da-b98de6397ef7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:19.165944 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7b8047bd-d5fc-4afe-a0da-b98de6397ef7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:19.176493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7b8047bd-d5fc-4afe-a0da-b98de6397ef7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:19.177234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7b8047bd-d5fc-4afe-a0da-b98de6397ef7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:19.178467 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7b8047bd-d5fc-4afe-a0da-b98de6397ef7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:19.179170 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7b8047bd-d5fc-4afe-a0da-b98de6397ef7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:19.308869 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7b8047bd-d5fc-4afe-a0da-b98de6397ef7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:19.317241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7b8047bd-d5fc-4afe-a0da-b98de6397ef7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.158598 Jun 23 08:21:19.317825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 86/184] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:19 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:19.918115 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bcb58bb5-1326-4c7f-8498-41383eeaf371 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:19.919141 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bcb58bb5-1326-4c7f-8498-41383eeaf371 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:19.929262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bcb58bb5-1326-4c7f-8498-41383eeaf371 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:19.929960 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bcb58bb5-1326-4c7f-8498-41383eeaf371 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:19.931253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bcb58bb5-1326-4c7f-8498-41383eeaf371 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:19.932020 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bcb58bb5-1326-4c7f-8498-41383eeaf371 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:20.010204 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-333759c6-d67a-497e-972b-011add773bb8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:20.010770 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-333759c6-d67a-497e-972b-011add773bb8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:20.017326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-333759c6-d67a-497e-972b-011add773bb8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:20.017769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-333759c6-d67a-497e-972b-011add773bb8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:20.018524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-333759c6-d67a-497e-972b-011add773bb8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:20.018952 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-333759c6-d67a-497e-972b-011add773bb8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:20.068850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bcb58bb5-1326-4c7f-8498-41383eeaf371 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:20.082487 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bcb58bb5-1326-4c7f-8498-41383eeaf371 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.169094 Jun 23 08:21:20.082487 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 99/185] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:19 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:20.092516 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:20.092696 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:20.098599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:20.099033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:20.099815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:20.100233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:20.153648 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-333759c6-d67a-497e-972b-011add773bb8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:20.161461 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-333759c6-d67a-497e-972b-011add773bb8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.155164 Jun 23 08:21:20.162031 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 87/186] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:20 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:20.233633 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:20.243572 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:20.246063 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:20.247844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1943ac4b-92b4-40fa-b59c-cc23e6c7ef18 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.159372 Jun 23 08:21:20.248836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 100/187] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:20 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:20.338964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-729a3fda-a3a0-4049-9b50-d1662e88a5ba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:20.340009 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-729a3fda-a3a0-4049-9b50-d1662e88a5ba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:20.350402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-729a3fda-a3a0-4049-9b50-d1662e88a5ba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:20.351138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-729a3fda-a3a0-4049-9b50-d1662e88a5ba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:20.352447 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-729a3fda-a3a0-4049-9b50-d1662e88a5ba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:20.353170 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-729a3fda-a3a0-4049-9b50-d1662e88a5ba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:20.492409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-729a3fda-a3a0-4049-9b50-d1662e88a5ba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:20.500696 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-729a3fda-a3a0-4049-9b50-d1662e88a5ba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.168150 Jun 23 08:21:20.501223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 88/188] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:20 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:21.102817 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a92b37fa-6338-4398-ae38-590291c8f9b5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:21.103686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a92b37fa-6338-4398-ae38-590291c8f9b5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:21.112609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a92b37fa-6338-4398-ae38-590291c8f9b5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:21.113406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a92b37fa-6338-4398-ae38-590291c8f9b5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:21.114498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a92b37fa-6338-4398-ae38-590291c8f9b5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:21.114996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a92b37fa-6338-4398-ae38-590291c8f9b5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:21.178782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6eee65a4-0ba8-43eb-9abe-779ffd5848ee tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:21.179424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6eee65a4-0ba8-43eb-9abe-779ffd5848ee tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:21.185872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6eee65a4-0ba8-43eb-9abe-779ffd5848ee tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:21.186309 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6eee65a4-0ba8-43eb-9abe-779ffd5848ee tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:21.187053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6eee65a4-0ba8-43eb-9abe-779ffd5848ee tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:21.187519 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6eee65a4-0ba8-43eb-9abe-779ffd5848ee tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:21.250543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a92b37fa-6338-4398-ae38-590291c8f9b5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:21.259235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a92b37fa-6338-4398-ae38-590291c8f9b5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.162951 Jun 23 08:21:21.259844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 101/189] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:21 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:21.271283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:21.271896 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:21.278534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:21.278995 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:21.280085 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:21.280605 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:21.316945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6eee65a4-0ba8-43eb-9abe-779ffd5848ee tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:21.324620 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6eee65a4-0ba8-43eb-9abe-779ffd5848ee tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.149640 Jun 23 08:21:21.325252 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 89/190] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:21 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:21.414667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:21.423156 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:21.424805 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:21.425903 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4d6bbdc4-8c06-4727-97c2-c3df3099d0c1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.158416 Jun 23 08:21:21.428069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 102/191] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:21 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:21.519087 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-02ded425-21f5-4e78-a55b-d770375271d1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:21.519743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-02ded425-21f5-4e78-a55b-d770375271d1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:21.526092 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02ded425-21f5-4e78-a55b-d770375271d1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:21.526852 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02ded425-21f5-4e78-a55b-d770375271d1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:21.528558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02ded425-21f5-4e78-a55b-d770375271d1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:21.528972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02ded425-21f5-4e78-a55b-d770375271d1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:21.674959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-02ded425-21f5-4e78-a55b-d770375271d1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:21.683045 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-02ded425-21f5-4e78-a55b-d770375271d1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.168177 Jun 23 08:21:21.683644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 90/192] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:21 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:22.280997 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9cf08a13-5314-4b1c-b740-1b030e2b9366 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:22.281582 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9cf08a13-5314-4b1c-b740-1b030e2b9366 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:22.287734 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9cf08a13-5314-4b1c-b740-1b030e2b9366 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:22.288181 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9cf08a13-5314-4b1c-b740-1b030e2b9366 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:22.288947 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9cf08a13-5314-4b1c-b740-1b030e2b9366 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:22.289381 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9cf08a13-5314-4b1c-b740-1b030e2b9366 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:22.342930 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2598f349-87af-4213-9ec1-933cd3a731fe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:22.343536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2598f349-87af-4213-9ec1-933cd3a731fe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:22.350006 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2598f349-87af-4213-9ec1-933cd3a731fe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:22.350441 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2598f349-87af-4213-9ec1-933cd3a731fe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:22.351197 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2598f349-87af-4213-9ec1-933cd3a731fe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:22.351663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2598f349-87af-4213-9ec1-933cd3a731fe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:22.422090 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9cf08a13-5314-4b1c-b740-1b030e2b9366 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:22.429726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9cf08a13-5314-4b1c-b740-1b030e2b9366 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.155487 Jun 23 08:21:22.430101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 103/193] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:22 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:22.443807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:22.444406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:22.450459 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:22.450902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:22.452376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:22.452799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:22.483294 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2598f349-87af-4213-9ec1-933cd3a731fe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:22.494255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2598f349-87af-4213-9ec1-933cd3a731fe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.155734 Jun 23 08:21:22.507390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 91/194] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:22 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:22.624914 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:22.634062 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:22.635768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:22.648297 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0110dc0a-848d-4172-8954-0261285f2c4b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.197814 Jun 23 08:21:22.650585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 104/195] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:22 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:22.700617 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d4e76cfb-b232-4184-9174-cee4bb3265b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:22.701678 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d4e76cfb-b232-4184-9174-cee4bb3265b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:22.709382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4e76cfb-b232-4184-9174-cee4bb3265b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:22.710028 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4e76cfb-b232-4184-9174-cee4bb3265b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:22.710784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4e76cfb-b232-4184-9174-cee4bb3265b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:22.711230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4e76cfb-b232-4184-9174-cee4bb3265b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:22.916524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d4e76cfb-b232-4184-9174-cee4bb3265b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:22.925078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d4e76cfb-b232-4184-9174-cee4bb3265b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.228764 Jun 23 08:21:22.927242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 92/196] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:22 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:23.412032 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-fa077617-0f9f-4fdb-ac7f-0c48ff00f809 req-fa4f256c-61a4-4c4e-bab8-182cebc395d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62a72a3-1376-4284-94a0-d57fbe81f1b9", "name": "network-vif-plugged", "status": "completed", "tag": "95dc486f-023d-4b75-87c7-155fbce47ca4"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:23.420872 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-fa077617-0f9f-4fdb-ac7f-0c48ff00f809 req-fa4f256c-61a4-4c4e-bab8-182cebc395d8 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.421309 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-fa077617-0f9f-4fdb-ac7f-0c48ff00f809 req-fa4f256c-61a4-4c4e-bab8-182cebc395d8 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:23.433552 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-fa077617-0f9f-4fdb-ac7f-0c48ff00f809 req-fa4f256c-61a4-4c4e-bab8-182cebc395d8 service nova] Creating event network-vif-plugged:95dc486f-023d-4b75-87c7-155fbce47ca4 for instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 on hv-cinder-84721 Jun 23 08:21:23.439370 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-fa077617-0f9f-4fdb-ac7f-0c48ff00f809 req-fa4f256c-61a4-4c4e-bab8-182cebc395d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030911 Jun 23 08:21:23.440209 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 105/197] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:23.445786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1cef33d8-42e5-482e-bc32-ffacdd62c18c tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:23.446424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1cef33d8-42e5-482e-bc32-ffacdd62c18c tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:23.453020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1cef33d8-42e5-482e-bc32-ffacdd62c18c tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.453532 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1cef33d8-42e5-482e-bc32-ffacdd62c18c tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:23.454336 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1cef33d8-42e5-482e-bc32-ffacdd62c18c tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.454815 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1cef33d8-42e5-482e-bc32-ffacdd62c18c tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:23.514460 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ddf0d181-d29e-46b0-a08f-4c057de61774 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:23.515144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ddf0d181-d29e-46b0-a08f-4c057de61774 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:23.521659 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddf0d181-d29e-46b0-a08f-4c057de61774 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.522094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddf0d181-d29e-46b0-a08f-4c057de61774 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:23.522845 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddf0d181-d29e-46b0-a08f-4c057de61774 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.523296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddf0d181-d29e-46b0-a08f-4c057de61774 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:23.588887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1cef33d8-42e5-482e-bc32-ffacdd62c18c tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:23.596461 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1cef33d8-42e5-482e-bc32-ffacdd62c18c tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.154486 Jun 23 08:21:23.596992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 93/198] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:23 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:23.667863 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ddf0d181-d29e-46b0-a08f-4c057de61774 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:23.668427 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:23.669002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:23.675608 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.676025 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ddf0d181-d29e-46b0-a08f-4c057de61774 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.166062 Jun 23 08:21:23.676183 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:23.676901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 106/199] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:23 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:23.677053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.677340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:23.814442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:23.822570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:23.824094 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:23.825184 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-fbf5e8b2-89ab-4bcf-9f3a-4009293bd23f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.160764 Jun 23 08:21:23.825733 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 94/200] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:23 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:23.942346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-53ad35d3-0a7e-4cd9-a567-8a0b4d169dc0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:23.942978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-53ad35d3-0a7e-4cd9-a567-8a0b4d169dc0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:23.949762 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53ad35d3-0a7e-4cd9-a567-8a0b4d169dc0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.950213 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53ad35d3-0a7e-4cd9-a567-8a0b4d169dc0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:23.950970 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53ad35d3-0a7e-4cd9-a567-8a0b4d169dc0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:23.952123 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53ad35d3-0a7e-4cd9-a567-8a0b4d169dc0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:24.098019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-53ad35d3-0a7e-4cd9-a567-8a0b4d169dc0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:24.109843 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-53ad35d3-0a7e-4cd9-a567-8a0b4d169dc0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.171419 Jun 23 08:21:24.110981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 107/201] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:23 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:24.614502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-947ee33d-55f5-4f01-b557-46a6b16b4700 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:24.615117 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-947ee33d-55f5-4f01-b557-46a6b16b4700 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:24.621220 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-947ee33d-55f5-4f01-b557-46a6b16b4700 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:24.621649 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-947ee33d-55f5-4f01-b557-46a6b16b4700 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:24.622442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-947ee33d-55f5-4f01-b557-46a6b16b4700 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:24.623170 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-947ee33d-55f5-4f01-b557-46a6b16b4700 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:24.693237 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3e00a4f2-fa87-459b-b3db-e261ea15e96d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:24.693771 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3e00a4f2-fa87-459b-b3db-e261ea15e96d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:24.699901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3e00a4f2-fa87-459b-b3db-e261ea15e96d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:24.700339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3e00a4f2-fa87-459b-b3db-e261ea15e96d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:24.701103 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3e00a4f2-fa87-459b-b3db-e261ea15e96d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:24.701524 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3e00a4f2-fa87-459b-b3db-e261ea15e96d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:24.787740 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-947ee33d-55f5-4f01-b557-46a6b16b4700 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:24.797299 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-947ee33d-55f5-4f01-b557-46a6b16b4700 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.186080 Jun 23 08:21:24.806524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 95/202] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:24 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:24.843559 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3e00a4f2-fa87-459b-b3db-e261ea15e96d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:24.845792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:24.846922 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:24.851241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3e00a4f2-fa87-459b-b3db-e261ea15e96d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.161934 Jun 23 08:21:24.860645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 108/203] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:24 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:24.862396 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:24.862871 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:24.863683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:24.864111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:24.996624 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:25.005126 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:25.016343 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:25.017699 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e5f8aabc-59dc-463a-a915-27f3d2c484d8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.177940 Jun 23 08:21:25.018457 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 96/204] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:24 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:25.129256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c5999608-916a-4482-81c1-0f9040f9b6cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:25.129983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c5999608-916a-4482-81c1-0f9040f9b6cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:25.136474 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5999608-916a-4482-81c1-0f9040f9b6cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:25.136968 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5999608-916a-4482-81c1-0f9040f9b6cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:25.137768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5999608-916a-4482-81c1-0f9040f9b6cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:25.138270 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5999608-916a-4482-81c1-0f9040f9b6cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:25.271396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c5999608-916a-4482-81c1-0f9040f9b6cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:25.279028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c5999608-916a-4482-81c1-0f9040f9b6cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.153692 Jun 23 08:21:25.279679 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 109/205] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:25 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:25.814847 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a9d41679-9c1c-4045-b18f-344440261490 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:25.815576 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a9d41679-9c1c-4045-b18f-344440261490 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:25.821669 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a9d41679-9c1c-4045-b18f-344440261490 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:25.822127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a9d41679-9c1c-4045-b18f-344440261490 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:25.822854 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a9d41679-9c1c-4045-b18f-344440261490 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:25.823308 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a9d41679-9c1c-4045-b18f-344440261490 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:25.868034 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-83de7533-fd1f-4e71-983d-8423af663358 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:25.868674 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-83de7533-fd1f-4e71-983d-8423af663358 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:25.875524 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-83de7533-fd1f-4e71-983d-8423af663358 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:25.875768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-83de7533-fd1f-4e71-983d-8423af663358 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:25.876637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-83de7533-fd1f-4e71-983d-8423af663358 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:25.877235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-83de7533-fd1f-4e71-983d-8423af663358 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:25.957769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a9d41679-9c1c-4045-b18f-344440261490 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:25.965758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a9d41679-9c1c-4045-b18f-344440261490 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.155345 Jun 23 08:21:25.966582 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 97/206] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:25 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:26.036787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:26.037383 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:26.043577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:26.044015 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:26.044774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:26.045229 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:26.064775 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-83de7533-fd1f-4e71-983d-8423af663358 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:26.073209 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-83de7533-fd1f-4e71-983d-8423af663358 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.209630 Jun 23 08:21:26.074031 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 110/207] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:25 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:26.183220 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:26.191663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:26.193236 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:26.194384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-71203b31-c10e-40f5-a61b-85f8178c714b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.161616 Jun 23 08:21:26.195058 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 98/208] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:26 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:26.296204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b9bbbafd-ea7e-4f91-9084-44adc26b4682 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:26.296841 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b9bbbafd-ea7e-4f91-9084-44adc26b4682 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:26.302804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b9bbbafd-ea7e-4f91-9084-44adc26b4682 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:26.303288 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b9bbbafd-ea7e-4f91-9084-44adc26b4682 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:26.304045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b9bbbafd-ea7e-4f91-9084-44adc26b4682 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:26.304467 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b9bbbafd-ea7e-4f91-9084-44adc26b4682 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:26.323611 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:26.441480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b9bbbafd-ea7e-4f91-9084-44adc26b4682 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:26.449905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b9bbbafd-ea7e-4f91-9084-44adc26b4682 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.157797 Jun 23 08:21:26.450531 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 111/209] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:26 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:26.983246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3f841902-9f9d-4220-8032-f02767eb278d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:26.984001 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3f841902-9f9d-4220-8032-f02767eb278d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:26.990560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3f841902-9f9d-4220-8032-f02767eb278d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:26.990915 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3f841902-9f9d-4220-8032-f02767eb278d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:26.991978 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3f841902-9f9d-4220-8032-f02767eb278d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:26.992411 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3f841902-9f9d-4220-8032-f02767eb278d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:27.090797 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6dece718-9807-4345-b107-ee63b5874c6f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:27.091618 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6dece718-9807-4345-b107-ee63b5874c6f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:27.097925 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dece718-9807-4345-b107-ee63b5874c6f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:27.098409 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dece718-9807-4345-b107-ee63b5874c6f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:27.099404 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dece718-9807-4345-b107-ee63b5874c6f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:27.099831 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dece718-9807-4345-b107-ee63b5874c6f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:27.217773 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3f841902-9f9d-4220-8032-f02767eb278d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:27.227081 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6dece718-9807-4345-b107-ee63b5874c6f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:27.232385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3f841902-9f9d-4220-8032-f02767eb278d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.253078 Jun 23 08:21:27.232962 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 99/210] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:26 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:27.235558 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6dece718-9807-4345-b107-ee63b5874c6f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.148733 Jun 23 08:21:27.236136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 112/211] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:27 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:27.237569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:27.238159 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:27.244116 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:27.244485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:27.245230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:27.245804 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:27.266703 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:27.423107 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:27.431859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:27.433512 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:27.434721 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f833a43a-30f2-48c5-9a29-ac800dc4c7e1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.200698 Jun 23 08:21:27.435518 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 100/212] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:27 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:27.468003 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-fa734c3e-898c-4e58-bd49-b5a6d0022d10 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:27.468726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-fa734c3e-898c-4e58-bd49-b5a6d0022d10 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:27.475693 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fa734c3e-898c-4e58-bd49-b5a6d0022d10 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:27.476143 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fa734c3e-898c-4e58-bd49-b5a6d0022d10 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:27.476992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fa734c3e-898c-4e58-bd49-b5a6d0022d10 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:27.477563 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fa734c3e-898c-4e58-bd49-b5a6d0022d10 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:27.664081 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-fa734c3e-898c-4e58-bd49-b5a6d0022d10 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:27.672342 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-fa734c3e-898c-4e58-bd49-b5a6d0022d10 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.209086 Jun 23 08:21:27.673110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 113/213] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:27 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:28.253047 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1e945625-8242-455e-9308-8f8ebcc5addc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:28.253732 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1e945625-8242-455e-9308-8f8ebcc5addc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:28.255049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c99735b0-4b04-49a8-89bc-7e895a306ed3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:28.255873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c99735b0-4b04-49a8-89bc-7e895a306ed3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:28.260012 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e945625-8242-455e-9308-8f8ebcc5addc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:28.260452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e945625-8242-455e-9308-8f8ebcc5addc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:28.261375 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e945625-8242-455e-9308-8f8ebcc5addc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:28.261799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e945625-8242-455e-9308-8f8ebcc5addc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:28.262086 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c99735b0-4b04-49a8-89bc-7e895a306ed3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:28.262525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c99735b0-4b04-49a8-89bc-7e895a306ed3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:28.263307 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c99735b0-4b04-49a8-89bc-7e895a306ed3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:28.264618 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c99735b0-4b04-49a8-89bc-7e895a306ed3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:28.403620 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1e945625-8242-455e-9308-8f8ebcc5addc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:28.405692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c99735b0-4b04-49a8-89bc-7e895a306ed3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:28.411562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1e945625-8242-455e-9308-8f8ebcc5addc tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.162792 Jun 23 08:21:28.412133 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 101/214] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:28 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:28.413084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c99735b0-4b04-49a8-89bc-7e895a306ed3 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1315 microversion: 2.1 time: 0.162914 Jun 23 08:21:28.413672 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 114/215] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:28 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:28.452371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:28.452960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:28.459442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:28.459881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:28.460592 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:28.461011 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:28.602973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:28.612182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:28.613678 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:28.614778 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4fb923f5-2f97-45cc-ad95-42c02ed43864 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.166136 Jun 23 08:21:28.615368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 102/216] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:28 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:28.693764 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c26c69f2-d537-4d16-83d1-ed764fd761bf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:28.694744 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c26c69f2-d537-4d16-83d1-ed764fd761bf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:28.703948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c26c69f2-d537-4d16-83d1-ed764fd761bf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:28.704044 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c26c69f2-d537-4d16-83d1-ed764fd761bf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:28.704925 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c26c69f2-d537-4d16-83d1-ed764fd761bf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:28.705363 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c26c69f2-d537-4d16-83d1-ed764fd761bf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:28.835022 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c26c69f2-d537-4d16-83d1-ed764fd761bf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:28.846666 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c26c69f2-d537-4d16-83d1-ed764fd761bf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1367 microversion: 2.1 time: 0.158953 Jun 23 08:21:28.847550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 115/217] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:28 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:29.431327 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c7d0d40c-d8e4-4d86-a74f-427a1513e1cc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:29.432090 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c7d0d40c-d8e4-4d86-a74f-427a1513e1cc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:29.432233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7029501a-ff08-4154-883f-d4fce6fba6b3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:29.432750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7029501a-ff08-4154-883f-d4fce6fba6b3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:29.439525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c7d0d40c-d8e4-4d86-a74f-427a1513e1cc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:29.439960 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c7d0d40c-d8e4-4d86-a74f-427a1513e1cc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:29.440926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c7d0d40c-d8e4-4d86-a74f-427a1513e1cc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:29.441505 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c7d0d40c-d8e4-4d86-a74f-427a1513e1cc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:29.441839 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7029501a-ff08-4154-883f-d4fce6fba6b3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:29.442387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7029501a-ff08-4154-883f-d4fce6fba6b3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:29.443250 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7029501a-ff08-4154-883f-d4fce6fba6b3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:29.443776 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7029501a-ff08-4154-883f-d4fce6fba6b3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:29.596131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c7d0d40c-d8e4-4d86-a74f-427a1513e1cc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:29.603811 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c7d0d40c-d8e4-4d86-a74f-427a1513e1cc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1502 microversion: 2.1 time: 0.176761 Jun 23 08:21:29.604508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 116/218] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:29 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:29.629472 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7029501a-ff08-4154-883f-d4fce6fba6b3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:29.637338 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7029501a-ff08-4154-883f-d4fce6fba6b3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.211206 Jun 23 08:21:29.644184 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 103/219] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:29 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:29.644341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:29.644341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:29.648550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:29.648988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:29.649732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:29.650153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:29.786024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:29.794777 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:29.796737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:29.797875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c891a88e-6414-457d-9426-171131e936cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.162404 Jun 23 08:21:29.798435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 117/220] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:29 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:29.873872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-77c635f2-bf4e-48c0-b431-0aa9a36800b3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:29.873872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-77c635f2-bf4e-48c0-b431-0aa9a36800b3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:29.876144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-77c635f2-bf4e-48c0-b431-0aa9a36800b3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:29.876469 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-77c635f2-bf4e-48c0-b431-0aa9a36800b3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:29.877266 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-77c635f2-bf4e-48c0-b431-0aa9a36800b3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:29.877894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-77c635f2-bf4e-48c0-b431-0aa9a36800b3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:30.019003 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-77c635f2-bf4e-48c0-b431-0aa9a36800b3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:30.026890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-77c635f2-bf4e-48c0-b431-0aa9a36800b3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1557 microversion: 2.1 time: 0.162341 Jun 23 08:21:30.027496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 104/221] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:29 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:30.044776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6378b1c7-d801-4845-8dc4-81021488e9f7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:30.045424 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6378b1c7-d801-4845-8dc4-81021488e9f7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:30.053010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6378b1c7-d801-4845-8dc4-81021488e9f7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:30.053746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6378b1c7-d801-4845-8dc4-81021488e9f7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:30.054931 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6378b1c7-d801-4845-8dc4-81021488e9f7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:30.055627 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6378b1c7-d801-4845-8dc4-81021488e9f7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:30.183647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6378b1c7-d801-4845-8dc4-81021488e9f7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142871 Jun 23 08:21:30.184239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 118/222] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 08:21:30 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:30.654716 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6cafebdf-3f21-498b-a951-db47d652908c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:30.655555 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6cafebdf-3f21-498b-a951-db47d652908c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:30.662315 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6cafebdf-3f21-498b-a951-db47d652908c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:30.662754 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6cafebdf-3f21-498b-a951-db47d652908c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:30.663556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6cafebdf-3f21-498b-a951-db47d652908c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:30.663984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6cafebdf-3f21-498b-a951-db47d652908c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:30.816377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:30.818155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:30.824574 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:30.825279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:30.826040 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:30.826463 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:30.961005 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:30.972078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:30.974304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:30.975456 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-456daf2a-77c4-4808-9b79-8e2041c20e40 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.163094 Jun 23 08:21:30.985320 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 119/223] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:30 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:31.000035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6cafebdf-3f21-498b-a951-db47d652908c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:31.007644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6cafebdf-3f21-498b-a951-db47d652908c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.356834 Jun 23 08:21:31.008213 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 105/224] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:30 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:31.600080 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-28d7b47e-1e2f-46dd-89d8-3087438e1270 req-afe9051f-755e-407a-aeab-4b0058c5d4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795dfab2-6368-40d4-bf89-95f37e857ceb", "tag": "9cdd8d49-4a4d-48e0-bf8b-c4d771ada3d9"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:31.608523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-28d7b47e-1e2f-46dd-89d8-3087438e1270 req-afe9051f-755e-407a-aeab-4b0058c5d4d6 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:31.608951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-28d7b47e-1e2f-46dd-89d8-3087438e1270 req-afe9051f-755e-407a-aeab-4b0058c5d4d6 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:31.621608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-28d7b47e-1e2f-46dd-89d8-3087438e1270 req-afe9051f-755e-407a-aeab-4b0058c5d4d6 service nova] Creating event network-changed:9cdd8d49-4a4d-48e0-bf8b-c4d771ada3d9 for instance 795dfab2-6368-40d4-bf89-95f37e857ceb on hv-cinder-84721 Jun 23 08:21:31.627292 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-28d7b47e-1e2f-46dd-89d8-3087438e1270 req-afe9051f-755e-407a-aeab-4b0058c5d4d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030892 Jun 23 08:21:31.627969 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 120/225] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:31.993692 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:31.994274 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:32.002439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:32.002879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:32.003665 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:32.004092 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:32.037288 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c2663572-fcbd-4383-8982-6f2225f3bcc8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:32.038089 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c2663572-fcbd-4383-8982-6f2225f3bcc8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:32.045077 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c2663572-fcbd-4383-8982-6f2225f3bcc8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:32.045620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c2663572-fcbd-4383-8982-6f2225f3bcc8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:32.046589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c2663572-fcbd-4383-8982-6f2225f3bcc8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:32.047370 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c2663572-fcbd-4383-8982-6f2225f3bcc8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:32.150370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:32.159120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:32.161345 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:32.163027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7676721d-90b4-407d-9492-47d1e86976f7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.173445 Jun 23 08:21:32.164227 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 106/226] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:31 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:32.181103 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c2663572-fcbd-4383-8982-6f2225f3bcc8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:32.188805 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c2663572-fcbd-4383-8982-6f2225f3bcc8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.167097 Jun 23 08:21:32.189374 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 121/227] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:32 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:33.185937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:33.187432 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:33.197785 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:33.198519 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:33.199827 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:33.200534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:33.206769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3b64133b-bedb-4b45-ab9c-86dad5eb092a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:33.207401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3b64133b-bedb-4b45-ab9c-86dad5eb092a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:33.214056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b64133b-bedb-4b45-ab9c-86dad5eb092a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:33.214498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b64133b-bedb-4b45-ab9c-86dad5eb092a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:33.215240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b64133b-bedb-4b45-ab9c-86dad5eb092a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:33.215709 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b64133b-bedb-4b45-ab9c-86dad5eb092a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:33.332789 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:33.340909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:33.342486 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:33.343691 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-31957524-3efe-4b9c-9948-2eed3132070f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.164494 Jun 23 08:21:33.344038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3b64133b-bedb-4b45-ab9c-86dad5eb092a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:33.344261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 107/228] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:33 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:33.351733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3b64133b-bedb-4b45-ab9c-86dad5eb092a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.148877 Jun 23 08:21:33.352289 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 122/229] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:33 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:34.366245 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:34.367533 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:34.372722 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6b941af2-29d6-40ba-b49f-279769b0e639 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:34.373997 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6b941af2-29d6-40ba-b49f-279769b0e639 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:34.376770 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:34.377543 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:34.378046 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:34.378467 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:34.380415 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b941af2-29d6-40ba-b49f-279769b0e639 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:34.380887 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b941af2-29d6-40ba-b49f-279769b0e639 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:34.381637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b941af2-29d6-40ba-b49f-279769b0e639 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:34.382056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b941af2-29d6-40ba-b49f-279769b0e639 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:34.517952 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6b941af2-29d6-40ba-b49f-279769b0e639 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:34.519660 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:34.525814 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6b941af2-29d6-40ba-b49f-279769b0e639 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.159652 Jun 23 08:21:34.526382 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 123/230] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:34 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:34.528689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:34.530288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:34.531558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b991a20e-33ad-4da4-9d26-21e4c1cbb3d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.172239 Jun 23 08:21:34.532169 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 108/231] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:34 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:35.543520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-58da7006-c26b-4b98-b8e2-100db3c7d9bf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:35.544932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-58da7006-c26b-4b98-b8e2-100db3c7d9bf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:35.550078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:35.550666 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:35.553841 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-58da7006-c26b-4b98-b8e2-100db3c7d9bf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:35.554439 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-58da7006-c26b-4b98-b8e2-100db3c7d9bf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:35.555367 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-58da7006-c26b-4b98-b8e2-100db3c7d9bf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:35.555870 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-58da7006-c26b-4b98-b8e2-100db3c7d9bf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:35.559770 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:35.560195 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:35.566933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:35.567402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:35.723360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:35.734514 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:35.736615 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:35.737926 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7ba7164b-2224-4d88-b13b-da3a194719ec tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.192522 Jun 23 08:21:35.739003 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 109/232] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:35 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:35.744280 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1281608944", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "networks": [{"uuid": "e8b230c3-b97b-4159-872a-2abe9ad01e6c"}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:35.760882 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-58da7006-c26b-4b98-b8e2-100db3c7d9bf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:35.777618 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-58da7006-c26b-4b98-b8e2-100db3c7d9bf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1321 microversion: 2.1 time: 0.236662 Jun 23 08:21:35.779765 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 124/233] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:35 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:35.814214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] validate_networks() for [('e8b230c3-b97b-4159-872a-2abe9ad01e6c', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:21:36.226560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:21:36.227929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:21:36.229026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:21:36.230113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:21:36.231277 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:21:36.242844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:36.243326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:36.244115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:36.244534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:36.263015 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Getting quotas for project bea8f88d81c04623b66edaf1cebc2ee3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:21:36.264654 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bc54526a-6f4d-4677-80c9-54a2808b6d50 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ce03435-301c-4758-aa9b-4d4ecfc47d8c"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:36.265826 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bc54526a-6f4d-4677-80c9-54a2808b6d50 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:36.267697 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Getting quotas for user 44b66024bd78487082154441343a2161 and project bea8f88d81c04623b66edaf1cebc2ee3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:21:36.272351 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc54526a-6f4d-4677-80c9-54a2808b6d50 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:36.272864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc54526a-6f4d-4677-80c9-54a2808b6d50 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:36.273565 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc54526a-6f4d-4677-80c9-54a2808b6d50 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:36.274156 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc54526a-6f4d-4677-80c9-54a2808b6d50 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:36.280211 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:21:36.282917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:21:36.328878 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f8cacac0-1385-4132-85aa-a95ec59168eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588631 Jun 23 08:21:36.329857 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 110/234] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:21:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:21:36.340549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2c7f7b94-907b-44b9-a0fa-89f3bba4e4b0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:36.341436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2c7f7b94-907b-44b9-a0fa-89f3bba4e4b0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:36.417712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2c7f7b94-907b-44b9-a0fa-89f3bba4e4b0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:36.427594 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2c7f7b94-907b-44b9-a0fa-89f3bba4e4b0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1219 microversion: 2.1 time: 0.091112 Jun 23 08:21:36.429913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 111/235] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:36 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:36.756636 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:36.757421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:36.763834 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:36.764356 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:36.765145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:36.765568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:36.903601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:36.912558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:36.914036 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:36.915127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-10fae9fb-3373-4113-977a-7be8ae0895db tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.162738 Jun 23 08:21:36.915712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 112/236] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:36 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:36.921137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c3a41c00-fbe1-4dfe-90cb-c2b4e74fb0eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:36.921913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c3a41c00-fbe1-4dfe-90cb-c2b4e74fb0eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:36.927893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3a41c00-fbe1-4dfe-90cb-c2b4e74fb0eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:36.928326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3a41c00-fbe1-4dfe-90cb-c2b4e74fb0eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:36.929069 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3a41c00-fbe1-4dfe-90cb-c2b4e74fb0eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:36.929513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3a41c00-fbe1-4dfe-90cb-c2b4e74fb0eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:37.068601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c3a41c00-fbe1-4dfe-90cb-c2b4e74fb0eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:37.076319 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c3a41c00-fbe1-4dfe-90cb-c2b4e74fb0eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1515 microversion: 2.1 time: 0.159393 Jun 23 08:21:37.077188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 113/237] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:36 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:37.095558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-79bb3e78-5e67-4886-9667-0fe30c759be6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:37.096686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-79bb3e78-5e67-4886-9667-0fe30c759be6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:37.103446 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79bb3e78-5e67-4886-9667-0fe30c759be6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:37.103826 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79bb3e78-5e67-4886-9667-0fe30c759be6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:37.104600 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79bb3e78-5e67-4886-9667-0fe30c759be6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:37.105026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79bb3e78-5e67-4886-9667-0fe30c759be6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:37.168165 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-79bb3e78-5e67-4886-9667-0fe30c759be6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lazy-loading 'flavor' on Instance uuid 8ba31757-3f23-4c93-8016-2448fa5510b9 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:21:37.293598 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-79bb3e78-5e67-4886-9667-0fe30c759be6 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9/action" status: 200 len: 32 microversion: 2.1 time: 0.203269 Jun 23 08:21:37.294205 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 114/238] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:21:37 2022] POST /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:21:37.304235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-21d48655-29a0-4b3c-8897-dba5b7ea5ba5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:37.304927 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-21d48655-29a0-4b3c-8897-dba5b7ea5ba5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:37.311412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-21d48655-29a0-4b3c-8897-dba5b7ea5ba5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:37.311865 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-21d48655-29a0-4b3c-8897-dba5b7ea5ba5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:37.312628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-21d48655-29a0-4b3c-8897-dba5b7ea5ba5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:37.313059 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-21d48655-29a0-4b3c-8897-dba5b7ea5ba5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:37.463773 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-21d48655-29a0-4b3c-8897-dba5b7ea5ba5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:37.473220 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-21d48655-29a0-4b3c-8897-dba5b7ea5ba5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.172945 Jun 23 08:21:37.473931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 115/239] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:37 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:37.481333 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-14b27e90-d4ad-4a97-a260-2f9ccacee697 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:37.482058 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-14b27e90-d4ad-4a97-a260-2f9ccacee697 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:37.490014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-14b27e90-d4ad-4a97-a260-2f9ccacee697 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:37.490454 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-14b27e90-d4ad-4a97-a260-2f9ccacee697 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:37.491436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-14b27e90-d4ad-4a97-a260-2f9ccacee697 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:37.491913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-14b27e90-d4ad-4a97-a260-2f9ccacee697 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:37.557167 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-14b27e90-d4ad-4a97-a260-2f9ccacee697 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:37.560795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:37.565663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-14b27e90-d4ad-4a97-a260-2f9ccacee697 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1223 microversion: 2.1 time: 0.090670 Jun 23 08:21:37.566238 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 116/240] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:37 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:37.936944 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:37.937587 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:37.943866 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:37.944305 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:37.945080 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:37.945500 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:38.099429 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:38.111492 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:38.113562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:38.115138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0d572a01-e43c-4e95-b3dd-0bcdca575e99 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.184091 Jun 23 08:21:38.116999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 117/241] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:37 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:38.494139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d7415a38-9c87-4419-8af1-8f254b428299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:38.494734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d7415a38-9c87-4419-8af1-8f254b428299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:38.496651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:38.505376 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d7415a38-9c87-4419-8af1-8f254b428299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:38.505879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d7415a38-9c87-4419-8af1-8f254b428299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:38.506699 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d7415a38-9c87-4419-8af1-8f254b428299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:38.507138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d7415a38-9c87-4419-8af1-8f254b428299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:38.665012 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d7415a38-9c87-4419-8af1-8f254b428299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:38.673308 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d7415a38-9c87-4419-8af1-8f254b428299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.184201 Jun 23 08:21:38.673895 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 118/242] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:38 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:38.688287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-df32f03e-6ef1-4583-b226-77e19e576417 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:38.688888 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-df32f03e-6ef1-4583-b226-77e19e576417 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:38.695524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-df32f03e-6ef1-4583-b226-77e19e576417 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:38.696027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-df32f03e-6ef1-4583-b226-77e19e576417 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:38.697020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-df32f03e-6ef1-4583-b226-77e19e576417 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:38.697507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-df32f03e-6ef1-4583-b226-77e19e576417 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:38.767956 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-df32f03e-6ef1-4583-b226-77e19e576417 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:38.776069 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-df32f03e-6ef1-4583-b226-77e19e576417 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1215 microversion: 2.1 time: 0.091789 Jun 23 08:21:38.776638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 119/243] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:38 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:39.134348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:39.135016 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:39.142046 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:39.142496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:39.143267 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:39.143705 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:39.279142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:39.287931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:39.289454 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:39.290562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c2d81636-eff3-4451-ac61-7e03cb6c0bb6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.160439 Jun 23 08:21:39.291123 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 120/244] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:39 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:39.691064 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-700fc7d2-102d-41a7-a490-322c9b500243 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:39.691646 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-700fc7d2-102d-41a7-a490-322c9b500243 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:39.698363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-700fc7d2-102d-41a7-a490-322c9b500243 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:39.698805 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-700fc7d2-102d-41a7-a490-322c9b500243 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:39.699605 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-700fc7d2-102d-41a7-a490-322c9b500243 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:39.700036 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-700fc7d2-102d-41a7-a490-322c9b500243 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:39.843672 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-700fc7d2-102d-41a7-a490-322c9b500243 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:39.851169 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-700fc7d2-102d-41a7-a490-322c9b500243 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.164062 Jun 23 08:21:39.851764 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 121/245] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:39 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:39.856217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-be76c199-7994-42b9-a9c2-359ba6dfadb3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:39.856796 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-be76c199-7994-42b9-a9c2-359ba6dfadb3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:39.862723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be76c199-7994-42b9-a9c2-359ba6dfadb3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:39.863159 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be76c199-7994-42b9-a9c2-359ba6dfadb3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:39.863945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be76c199-7994-42b9-a9c2-359ba6dfadb3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:39.864359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be76c199-7994-42b9-a9c2-359ba6dfadb3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:39.930056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-be76c199-7994-42b9-a9c2-359ba6dfadb3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:39.937784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-be76c199-7994-42b9-a9c2-359ba6dfadb3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1215 microversion: 2.1 time: 0.085068 Jun 23 08:21:39.938342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 122/246] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:39 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:40.309128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:40.309828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:40.316181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:40.316645 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:40.317393 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:40.317825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:40.447187 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:40.455338 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:40.456809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:40.457958 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9b715a87-cdbe-4ebb-bea4-74558d97d317 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.152848 Jun 23 08:21:40.458509 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 123/247] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:40 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:40.871115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1fe4fe5e-8e3a-499d-80cb-ca366f1f020f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:40.872028 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1fe4fe5e-8e3a-499d-80cb-ca366f1f020f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:40.880663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1fe4fe5e-8e3a-499d-80cb-ca366f1f020f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:40.881234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1fe4fe5e-8e3a-499d-80cb-ca366f1f020f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:40.882203 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1fe4fe5e-8e3a-499d-80cb-ca366f1f020f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:40.882767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1fe4fe5e-8e3a-499d-80cb-ca366f1f020f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:41.028611 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1fe4fe5e-8e3a-499d-80cb-ca366f1f020f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:41.038362 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1fe4fe5e-8e3a-499d-80cb-ca366f1f020f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.172004 Jun 23 08:21:41.038950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 124/248] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:40 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:41.044393 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-12d110c0-2080-4242-86ee-2d485725ed21 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:41.045243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-12d110c0-2080-4242-86ee-2d485725ed21 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:41.052451 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12d110c0-2080-4242-86ee-2d485725ed21 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:41.052892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12d110c0-2080-4242-86ee-2d485725ed21 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:41.053649 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12d110c0-2080-4242-86ee-2d485725ed21 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:41.054076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12d110c0-2080-4242-86ee-2d485725ed21 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:41.118537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-12d110c0-2080-4242-86ee-2d485725ed21 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:41.128234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-12d110c0-2080-4242-86ee-2d485725ed21 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1215 microversion: 2.1 time: 0.088242 Jun 23 08:21:41.128802 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 125/249] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:41 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:41.479881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:41.480589 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:41.488123 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:41.488558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:41.489325 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:41.489747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:41.639361 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:41.650165 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:41.652123 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:41.653356 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cd0fd652-b870-4197-a4eb-fa5aa06f30a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.179747 Jun 23 08:21:41.654056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 126/250] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:41 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:42.056522 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-684295e8-2f40-489a-97ab-e8ea65e00c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:42.057118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-684295e8-2f40-489a-97ab-e8ea65e00c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:42.065026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-684295e8-2f40-489a-97ab-e8ea65e00c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:42.065628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-684295e8-2f40-489a-97ab-e8ea65e00c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:42.066723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-684295e8-2f40-489a-97ab-e8ea65e00c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:42.067333 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-684295e8-2f40-489a-97ab-e8ea65e00c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:42.307019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bc54526a-6f4d-4677-80c9-54a2808b6d50 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "POST /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.046168 Jun 23 08:21:42.308256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 125/251] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:21:36 2022] POST /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018/os-volume_attachments => generated 194 bytes in 6048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:21:42.314494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0ce0366e-e990-413f-908d-6b4fb7aef211 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:42.315602 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0ce0366e-e990-413f-908d-6b4fb7aef211 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:42.324327 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0ce0366e-e990-413f-908d-6b4fb7aef211 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:42.325181 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0ce0366e-e990-413f-908d-6b4fb7aef211 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:42.325962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0ce0366e-e990-413f-908d-6b4fb7aef211 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:42.326724 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0ce0366e-e990-413f-908d-6b4fb7aef211 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:42.370108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-684295e8-2f40-489a-97ab-e8ea65e00c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:42.390579 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-684295e8-2f40-489a-97ab-e8ea65e00c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.332056 Jun 23 08:21:42.400263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 127/252] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:42 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:42.412360 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0ce0366e-e990-413f-908d-6b4fb7aef211 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:42.420721 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0ce0366e-e990-413f-908d-6b4fb7aef211 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1271 microversion: 2.1 time: 0.110706 Jun 23 08:21:42.421639 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 126/253] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:42 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:42.677739 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:42.677739 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:42.679384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:42.680081 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:42.680854 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:42.681278 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:42.820981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:42.829600 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:42.831081 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:42.833894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bf9acb93-3c4d-4f8f-8fe8-810ead456000 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1406 microversion: 2.20 time: 0.164161 Jun 23 08:21:42.833894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 128/254] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:42 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:21:43.408700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3a908bba-fb12-4433-99ed-f27cc0f05046 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:43.409327 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3a908bba-fb12-4433-99ed-f27cc0f05046 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:43.415972 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3a908bba-fb12-4433-99ed-f27cc0f05046 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:43.416597 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3a908bba-fb12-4433-99ed-f27cc0f05046 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:43.417121 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3a908bba-fb12-4433-99ed-f27cc0f05046 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:43.417518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3a908bba-fb12-4433-99ed-f27cc0f05046 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:43.443198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e89bbca0-5ced-4483-add1-549ec4a115ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:43.443929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e89bbca0-5ced-4483-add1-549ec4a115ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:43.450715 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e89bbca0-5ced-4483-add1-549ec4a115ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:43.451302 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e89bbca0-5ced-4483-add1-549ec4a115ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:43.452682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e89bbca0-5ced-4483-add1-549ec4a115ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:43.453288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e89bbca0-5ced-4483-add1-549ec4a115ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:43.521350 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e89bbca0-5ced-4483-add1-549ec4a115ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:43.531944 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e89bbca0-5ced-4483-add1-549ec4a115ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1271 microversion: 2.1 time: 0.093264 Jun 23 08:21:43.532528 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 129/255] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:43 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:43.556192 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3a908bba-fb12-4433-99ed-f27cc0f05046 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:43.560202 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:43.566380 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3a908bba-fb12-4433-99ed-f27cc0f05046 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.161275 Jun 23 08:21:43.567173 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 127/256] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:43 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:43.853507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:43.854125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:43.860601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:43.861052 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:43.862681 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:43.863124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:44.039847 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:44.049853 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:44.051896 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:44.053345 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-899f24b6-b819-47df-8d0c-2367812619e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1598 microversion: 2.20 time: 0.207202 Jun 23 08:21:44.053944 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 130/257] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:21:43 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1598 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:21:44.074113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ddb2fc34-ee42-435c-9d69-cdb606f57722 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:44.074609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ddb2fc34-ee42-435c-9d69-cdb606f57722 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:44.082800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddb2fc34-ee42-435c-9d69-cdb606f57722 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:44.083535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddb2fc34-ee42-435c-9d69-cdb606f57722 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:44.084312 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddb2fc34-ee42-435c-9d69-cdb606f57722 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:44.084739 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddb2fc34-ee42-435c-9d69-cdb606f57722 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:44.174907 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ddb2fc34-ee42-435c-9d69-cdb606f57722 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104966 Jun 23 08:21:44.175742 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 128/258] 10.222.0.33 () {60 vars in 1315 bytes} [Thu Jun 23 08:21:44 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:21:44.551727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bf70220b-2d2d-46f0-8990-7fc89ac2ab22 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:44.552656 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bf70220b-2d2d-46f0-8990-7fc89ac2ab22 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:44.565497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf70220b-2d2d-46f0-8990-7fc89ac2ab22 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:44.565979 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf70220b-2d2d-46f0-8990-7fc89ac2ab22 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:44.566809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf70220b-2d2d-46f0-8990-7fc89ac2ab22 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:44.567274 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf70220b-2d2d-46f0-8990-7fc89ac2ab22 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:44.585625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-16ece34c-fc3a-4d6d-9f4c-0124cf47d28f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:44.586777 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-16ece34c-fc3a-4d6d-9f4c-0124cf47d28f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:44.598895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-16ece34c-fc3a-4d6d-9f4c-0124cf47d28f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:44.599674 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-16ece34c-fc3a-4d6d-9f4c-0124cf47d28f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:44.600623 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-16ece34c-fc3a-4d6d-9f4c-0124cf47d28f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:44.601202 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-16ece34c-fc3a-4d6d-9f4c-0124cf47d28f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:44.727998 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bf70220b-2d2d-46f0-8990-7fc89ac2ab22 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:44.740969 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bf70220b-2d2d-46f0-8990-7fc89ac2ab22 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1277 microversion: 2.1 time: 0.191073 Jun 23 08:21:44.742259 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 131/259] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:44 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:45.006508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-16ece34c-fc3a-4d6d-9f4c-0124cf47d28f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:45.030716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-16ece34c-fc3a-4d6d-9f4c-0124cf47d28f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.449285 Jun 23 08:21:45.031599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 129/260] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:44 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:45.761118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-40483f97-38fc-4ed0-a1d9-4df01361dc64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:45.762849 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-40483f97-38fc-4ed0-a1d9-4df01361dc64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:45.772328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-40483f97-38fc-4ed0-a1d9-4df01361dc64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:45.772945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-40483f97-38fc-4ed0-a1d9-4df01361dc64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:45.773814 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-40483f97-38fc-4ed0-a1d9-4df01361dc64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:45.774763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-40483f97-38fc-4ed0-a1d9-4df01361dc64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:45.894576 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-4d7d1f71-e23f-4ff1-add1-e18afa9d43ad req-7b2e0d60-c2c9-4a1d-8a74-fbf11baf8c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62a72a3-1376-4284-94a0-d57fbe81f1b9", "tag": "95dc486f-023d-4b75-87c7-155fbce47ca4"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:45.903943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-40483f97-38fc-4ed0-a1d9-4df01361dc64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:45.906428 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-4d7d1f71-e23f-4ff1-add1-e18afa9d43ad req-7b2e0d60-c2c9-4a1d-8a74-fbf11baf8c33 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:45.907140 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-4d7d1f71-e23f-4ff1-add1-e18afa9d43ad req-7b2e0d60-c2c9-4a1d-8a74-fbf11baf8c33 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:45.921077 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-4d7d1f71-e23f-4ff1-add1-e18afa9d43ad req-7b2e0d60-c2c9-4a1d-8a74-fbf11baf8c33 service nova] Creating event network-changed:95dc486f-023d-4b75-87c7-155fbce47ca4 for instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 on hv-cinder-84721 Jun 23 08:21:45.921295 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-40483f97-38fc-4ed0-a1d9-4df01361dc64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1277 microversion: 2.1 time: 0.163872 Jun 23 08:21:45.922125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 132/261] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:45 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:45.928367 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-4d7d1f71-e23f-4ff1-add1-e18afa9d43ad req-7b2e0d60-c2c9-4a1d-8a74-fbf11baf8c33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036998 Jun 23 08:21:45.929065 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 130/262] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:21:46.050738 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0a63e84d-606b-4ed3-abac-da367dce6d60 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:46.051651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0a63e84d-606b-4ed3-abac-da367dce6d60 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:46.062851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a63e84d-606b-4ed3-abac-da367dce6d60 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:46.063365 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a63e84d-606b-4ed3-abac-da367dce6d60 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:46.074291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a63e84d-606b-4ed3-abac-da367dce6d60 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:46.076537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a63e84d-606b-4ed3-abac-da367dce6d60 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:46.105989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:46.234812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0a63e84d-606b-4ed3-abac-da367dce6d60 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:46.244342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0a63e84d-606b-4ed3-abac-da367dce6d60 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.199843 Jun 23 08:21:46.245037 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 133/263] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:46 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:46.943426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a0225237-d33c-4eef-86d8-efb528c8d75b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:46.944128 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a0225237-d33c-4eef-86d8-efb528c8d75b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:46.946245 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=75 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:46.953853 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a0225237-d33c-4eef-86d8-efb528c8d75b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:46.954291 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a0225237-d33c-4eef-86d8-efb528c8d75b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:46.955085 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a0225237-d33c-4eef-86d8-efb528c8d75b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:46.955578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a0225237-d33c-4eef-86d8-efb528c8d75b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:47.092435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a0225237-d33c-4eef-86d8-efb528c8d75b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:47.103917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a0225237-d33c-4eef-86d8-efb528c8d75b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.165304 Jun 23 08:21:47.104617 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 131/264] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:46 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:47.265941 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1bf4b1da-e410-4de9-87ba-1a97d722eb05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:47.266718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1bf4b1da-e410-4de9-87ba-1a97d722eb05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:47.269436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:47.270298 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=8 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:47.301430 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1bf4b1da-e410-4de9-87ba-1a97d722eb05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:47.302004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1bf4b1da-e410-4de9-87ba-1a97d722eb05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:47.306940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1bf4b1da-e410-4de9-87ba-1a97d722eb05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:47.307259 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1bf4b1da-e410-4de9-87ba-1a97d722eb05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:47.624554 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1bf4b1da-e410-4de9-87ba-1a97d722eb05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:47.646958 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1bf4b1da-e410-4de9-87ba-1a97d722eb05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.385381 Jun 23 08:21:47.648089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 134/265] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:47 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:48.121247 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-54e9a914-a825-40d5-af5c-c1b62f0597e8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:48.121807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-54e9a914-a825-40d5-af5c-c1b62f0597e8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:48.129884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-54e9a914-a825-40d5-af5c-c1b62f0597e8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:48.130330 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-54e9a914-a825-40d5-af5c-c1b62f0597e8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:48.131102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-54e9a914-a825-40d5-af5c-c1b62f0597e8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:48.131550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-54e9a914-a825-40d5-af5c-c1b62f0597e8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:48.261869 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-2b982a13-a895-48f4-b10d-4528ade65dd6 req-cb064673-35cc-4eb0-bf01-c59982dcca0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c73899-1dfd-4ce2-b988-681df43ef5e6", "tag": "b573fb6b-6e0a-4c90-ab3c-be2c12dcf1ad"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:48.267483 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-54e9a914-a825-40d5-af5c-c1b62f0597e8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:48.274027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-2b982a13-a895-48f4-b10d-4528ade65dd6 req-cb064673-35cc-4eb0-bf01-c59982dcca0c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:48.274557 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-2b982a13-a895-48f4-b10d-4528ade65dd6 req-cb064673-35cc-4eb0-bf01-c59982dcca0c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:48.274926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-54e9a914-a825-40d5-af5c-c1b62f0597e8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.157683 Jun 23 08:21:48.275703 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 132/266] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:48 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:48.289480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-2b982a13-a895-48f4-b10d-4528ade65dd6 req-cb064673-35cc-4eb0-bf01-c59982dcca0c service nova] Creating event network-changed:b573fb6b-6e0a-4c90-ab3c-be2c12dcf1ad for instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 on hv-cinder-84721 Jun 23 08:21:48.294859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-2b982a13-a895-48f4-b10d-4528ade65dd6 req-cb064673-35cc-4eb0-bf01-c59982dcca0c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038265 Jun 23 08:21:48.295752 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 135/267] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:48.671231 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-542c53a4-1fd3-400b-88a8-526299554889 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:48.671925 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-542c53a4-1fd3-400b-88a8-526299554889 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:48.680275 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-542c53a4-1fd3-400b-88a8-526299554889 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:48.680789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-542c53a4-1fd3-400b-88a8-526299554889 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:48.681870 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-542c53a4-1fd3-400b-88a8-526299554889 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:48.682492 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-542c53a4-1fd3-400b-88a8-526299554889 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:48.826410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-542c53a4-1fd3-400b-88a8-526299554889 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:48.834068 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-542c53a4-1fd3-400b-88a8-526299554889 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.167860 Jun 23 08:21:48.834640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 133/268] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:48 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:49.294208 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8c3fa067-62d2-4162-9ef0-166b7d3ddfa3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:49.294919 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8c3fa067-62d2-4162-9ef0-166b7d3ddfa3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:49.301659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8c3fa067-62d2-4162-9ef0-166b7d3ddfa3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:49.302102 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8c3fa067-62d2-4162-9ef0-166b7d3ddfa3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:49.302864 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8c3fa067-62d2-4162-9ef0-166b7d3ddfa3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:49.303305 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8c3fa067-62d2-4162-9ef0-166b7d3ddfa3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:49.448717 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8c3fa067-62d2-4162-9ef0-166b7d3ddfa3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:49.456819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8c3fa067-62d2-4162-9ef0-166b7d3ddfa3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.166983 Jun 23 08:21:49.457407 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 136/269] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:49 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:49.851572 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0597902a-7528-468a-8042-311d37ab5c43 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:49.852182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0597902a-7528-468a-8042-311d37ab5c43 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:49.859227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0597902a-7528-468a-8042-311d37ab5c43 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:49.859694 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0597902a-7528-468a-8042-311d37ab5c43 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:49.860455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0597902a-7528-468a-8042-311d37ab5c43 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:49.860892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0597902a-7528-468a-8042-311d37ab5c43 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:50.006194 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0597902a-7528-468a-8042-311d37ab5c43 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:50.015442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0597902a-7528-468a-8042-311d37ab5c43 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.167417 Jun 23 08:21:50.016004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 134/270] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:49 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:50.475550 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-36d053f2-a5cc-41be-aa1e-d3d287d52e2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:50.476175 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-36d053f2-a5cc-41be-aa1e-d3d287d52e2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:50.482928 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36d053f2-a5cc-41be-aa1e-d3d287d52e2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:50.483463 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36d053f2-a5cc-41be-aa1e-d3d287d52e2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:50.484213 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36d053f2-a5cc-41be-aa1e-d3d287d52e2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:50.484638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36d053f2-a5cc-41be-aa1e-d3d287d52e2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:50.628473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-36d053f2-a5cc-41be-aa1e-d3d287d52e2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:50.636469 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-36d053f2-a5cc-41be-aa1e-d3d287d52e2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.165183 Jun 23 08:21:50.637009 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 137/271] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:50 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:51.032767 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4244072c-3154-46a7-957c-4ba6500b01e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:51.033495 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4244072c-3154-46a7-957c-4ba6500b01e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:51.040606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4244072c-3154-46a7-957c-4ba6500b01e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:51.041059 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4244072c-3154-46a7-957c-4ba6500b01e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:51.041854 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4244072c-3154-46a7-957c-4ba6500b01e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:51.042288 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4244072c-3154-46a7-957c-4ba6500b01e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:51.184472 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4244072c-3154-46a7-957c-4ba6500b01e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:51.193728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4244072c-3154-46a7-957c-4ba6500b01e7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.165559 Jun 23 08:21:51.194370 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 135/272] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:51 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:51.657780 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c5b7bfd5-4c78-41f4-91f8-79e247321665 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:51.658354 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c5b7bfd5-4c78-41f4-91f8-79e247321665 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:51.664912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5b7bfd5-4c78-41f4-91f8-79e247321665 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:51.665370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5b7bfd5-4c78-41f4-91f8-79e247321665 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:51.666090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5b7bfd5-4c78-41f4-91f8-79e247321665 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:51.666511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5b7bfd5-4c78-41f4-91f8-79e247321665 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:51.931401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c5b7bfd5-4c78-41f4-91f8-79e247321665 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:51.939773 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c5b7bfd5-4c78-41f4-91f8-79e247321665 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.286340 Jun 23 08:21:51.940359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 138/273] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:51 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:52.063635 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5869dbc4-53d0-496a-bd31-447986d63f30 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:52.064214 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5869dbc4-53d0-496a-bd31-447986d63f30 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:52.070697 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5869dbc4-53d0-496a-bd31-447986d63f30 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:52.071130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5869dbc4-53d0-496a-bd31-447986d63f30 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:52.071915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5869dbc4-53d0-496a-bd31-447986d63f30 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:52.072315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5869dbc4-53d0-496a-bd31-447986d63f30 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:52.099399 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5869dbc4-53d0-496a-bd31-447986d63f30 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:21:52.194528 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5869dbc4-53d0-496a-bd31-447986d63f30 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "DELETE /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 204 len: 0 microversion: 2.1 time: 0.134903 Jun 23 08:21:52.195118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 136/274] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:21:52 2022] DELETE /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:21:52.203767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-15174538-b02c-4795-bb32-dbdd0157125a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:52.204366 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-15174538-b02c-4795-bb32-dbdd0157125a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:52.210883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-15174538-b02c-4795-bb32-dbdd0157125a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:52.211370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-15174538-b02c-4795-bb32-dbdd0157125a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:52.212157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-15174538-b02c-4795-bb32-dbdd0157125a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:52.212287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3578194a-b7ac-4473-a27c-0093caa4a342 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:52.212564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-15174538-b02c-4795-bb32-dbdd0157125a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:52.213386 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3578194a-b7ac-4473-a27c-0093caa4a342 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:52.220579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3578194a-b7ac-4473-a27c-0093caa4a342 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:52.221254 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3578194a-b7ac-4473-a27c-0093caa4a342 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:52.222256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3578194a-b7ac-4473-a27c-0093caa4a342 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:52.222890 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3578194a-b7ac-4473-a27c-0093caa4a342 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:52.358883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3578194a-b7ac-4473-a27c-0093caa4a342 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:52.367303 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3578194a-b7ac-4473-a27c-0093caa4a342 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.159498 Jun 23 08:21:52.367859 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 137/275] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:52 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:52.620689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-15174538-b02c-4795-bb32-dbdd0157125a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:52.629924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-15174538-b02c-4795-bb32-dbdd0157125a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1554 microversion: 2.1 time: 0.430630 Jun 23 08:21:52.630507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 139/276] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:52 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1554 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:52.956411 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8cb7451e-8393-476b-a3da-34f39749301e tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:52.956978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8cb7451e-8393-476b-a3da-34f39749301e tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:52.963522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8cb7451e-8393-476b-a3da-34f39749301e tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:52.964052 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8cb7451e-8393-476b-a3da-34f39749301e tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:52.964817 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8cb7451e-8393-476b-a3da-34f39749301e tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:52.965385 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8cb7451e-8393-476b-a3da-34f39749301e tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:53.099804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8cb7451e-8393-476b-a3da-34f39749301e tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:53.107498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8cb7451e-8393-476b-a3da-34f39749301e tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.155046 Jun 23 08:21:53.108296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 138/277] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:52 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:53.385501 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-874c5b76-ba41-4527-b036-932ecc4ac299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:53.386157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-874c5b76-ba41-4527-b036-932ecc4ac299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:53.392967 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-874c5b76-ba41-4527-b036-932ecc4ac299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:53.393510 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-874c5b76-ba41-4527-b036-932ecc4ac299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:53.394402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-874c5b76-ba41-4527-b036-932ecc4ac299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:53.394952 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-874c5b76-ba41-4527-b036-932ecc4ac299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:53.531810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-874c5b76-ba41-4527-b036-932ecc4ac299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:53.539758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-874c5b76-ba41-4527-b036-932ecc4ac299 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.158343 Jun 23 08:21:53.540362 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 140/278] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:53 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:53.647544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-75f5f6f7-401d-40f3-a31a-69f298aa7022 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:53.648153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-75f5f6f7-401d-40f3-a31a-69f298aa7022 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:53.654946 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-75f5f6f7-401d-40f3-a31a-69f298aa7022 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:53.655791 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-75f5f6f7-401d-40f3-a31a-69f298aa7022 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:53.657016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-75f5f6f7-401d-40f3-a31a-69f298aa7022 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:53.657790 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-75f5f6f7-401d-40f3-a31a-69f298aa7022 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:54.104038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-75f5f6f7-401d-40f3-a31a-69f298aa7022 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:54.113724 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-75f5f6f7-401d-40f3-a31a-69f298aa7022 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1554 microversion: 2.1 time: 0.470273 Jun 23 08:21:54.114690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 139/279] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:53 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1554 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:54.124381 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5c4fc547-4c0b-4a42-a64b-091c45f39d58 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:54.124519 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5c4fc547-4c0b-4a42-a64b-091c45f39d58 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:54.130571 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5c4fc547-4c0b-4a42-a64b-091c45f39d58 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:54.130997 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5c4fc547-4c0b-4a42-a64b-091c45f39d58 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:54.132109 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5c4fc547-4c0b-4a42-a64b-091c45f39d58 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:54.132527 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5c4fc547-4c0b-4a42-a64b-091c45f39d58 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:54.558158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0f744f46-dd3c-429b-88f3-a21a8b9ed88d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:54.559260 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0f744f46-dd3c-429b-88f3-a21a8b9ed88d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:54.566252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0f744f46-dd3c-429b-88f3-a21a8b9ed88d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:54.566962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0f744f46-dd3c-429b-88f3-a21a8b9ed88d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:54.567948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0f744f46-dd3c-429b-88f3-a21a8b9ed88d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:54.568553 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0f744f46-dd3c-429b-88f3-a21a8b9ed88d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:54.735413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5c4fc547-4c0b-4a42-a64b-091c45f39d58 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:54.753039 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5c4fc547-4c0b-4a42-a64b-091c45f39d58 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.626657 Jun 23 08:21:54.753880 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 141/280] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:54 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:54.826651 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0f744f46-dd3c-429b-88f3-a21a8b9ed88d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:54.834713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0f744f46-dd3c-429b-88f3-a21a8b9ed88d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.281567 Jun 23 08:21:54.835279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 140/281] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:54 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:55.132264 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d4f56f5a-749c-48fa-a80c-c99ac446c4c6 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:55.133567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d4f56f5a-749c-48fa-a80c-c99ac446c4c6 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:55.141555 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4f56f5a-749c-48fa-a80c-c99ac446c4c6 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:55.142387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4f56f5a-749c-48fa-a80c-c99ac446c4c6 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:55.144459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4f56f5a-749c-48fa-a80c-c99ac446c4c6 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:55.145560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4f56f5a-749c-48fa-a80c-c99ac446c4c6 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:55.327438 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d4f56f5a-749c-48fa-a80c-c99ac446c4c6 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:55.335868 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d4f56f5a-749c-48fa-a80c-c99ac446c4c6 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1554 microversion: 2.1 time: 0.207848 Jun 23 08:21:55.336838 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 142/282] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:55 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1554 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:55.769803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3320efdb-7c5f-4622-af36-abec2ef4ed0a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:55.772621 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3320efdb-7c5f-4622-af36-abec2ef4ed0a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:55.780444 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3320efdb-7c5f-4622-af36-abec2ef4ed0a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:55.781146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3320efdb-7c5f-4622-af36-abec2ef4ed0a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:55.782471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3320efdb-7c5f-4622-af36-abec2ef4ed0a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:55.783063 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3320efdb-7c5f-4622-af36-abec2ef4ed0a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:55.852185 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d249b286-c23e-43b7-90bf-8f7b10306a6c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:55.853725 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d249b286-c23e-43b7-90bf-8f7b10306a6c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:55.867368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d249b286-c23e-43b7-90bf-8f7b10306a6c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:55.868004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d249b286-c23e-43b7-90bf-8f7b10306a6c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:55.870440 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d249b286-c23e-43b7-90bf-8f7b10306a6c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:55.871593 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d249b286-c23e-43b7-90bf-8f7b10306a6c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:56.000586 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3320efdb-7c5f-4622-af36-abec2ef4ed0a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:56.012504 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3320efdb-7c5f-4622-af36-abec2ef4ed0a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.246510 Jun 23 08:21:56.013527 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 141/283] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:55 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:56.177768 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d249b286-c23e-43b7-90bf-8f7b10306a6c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:56.189996 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d249b286-c23e-43b7-90bf-8f7b10306a6c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.340973 Jun 23 08:21:56.191174 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 143/284] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:55 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:56.354372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c68de098-2edd-4dc6-a4c3-84d317c5ea6d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:56.355146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c68de098-2edd-4dc6-a4c3-84d317c5ea6d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:56.365332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c68de098-2edd-4dc6-a4c3-84d317c5ea6d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:56.367650 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c68de098-2edd-4dc6-a4c3-84d317c5ea6d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:56.368548 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c68de098-2edd-4dc6-a4c3-84d317c5ea6d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:56.369569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c68de098-2edd-4dc6-a4c3-84d317c5ea6d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:56.527127 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c68de098-2edd-4dc6-a4c3-84d317c5ea6d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:56.544179 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c68de098-2edd-4dc6-a4c3-84d317c5ea6d tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1512 microversion: 2.1 time: 0.193627 Jun 23 08:21:56.546121 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 142/285] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:56 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:56.613695 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-f5c2e3f7-04a5-4f30-b7fd-53083f5cb161 req-9c3f8037-bccb-41ee-80bb-2354893fe365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621b2677-57b0-46a1-a540-efec39d1b018", "name": "network-vif-deleted", "tag": "ad0fc4d0-bce3-4944-97da-42c68812609c"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:21:56.622138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f5c2e3f7-04a5-4f30-b7fd-53083f5cb161 req-9c3f8037-bccb-41ee-80bb-2354893fe365 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:56.622574 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f5c2e3f7-04a5-4f30-b7fd-53083f5cb161 req-9c3f8037-bccb-41ee-80bb-2354893fe365 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:56.639134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-f5c2e3f7-04a5-4f30-b7fd-53083f5cb161 req-9c3f8037-bccb-41ee-80bb-2354893fe365 service nova] Creating event network-vif-deleted:ad0fc4d0-bce3-4944-97da-42c68812609c for instance 621b2677-57b0-46a1-a540-efec39d1b018 on hv-cinder-84721 Jun 23 08:21:56.646819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-f5c2e3f7-04a5-4f30-b7fd-53083f5cb161 req-9c3f8037-bccb-41ee-80bb-2354893fe365 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036704 Jun 23 08:21:56.647566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 144/286] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:21:57.031522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-da5569d7-2d86-4a00-9a13-87e27730448c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:57.032557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-da5569d7-2d86-4a00-9a13-87e27730448c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:57.041209 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-da5569d7-2d86-4a00-9a13-87e27730448c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:57.044345 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-da5569d7-2d86-4a00-9a13-87e27730448c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:57.046296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-da5569d7-2d86-4a00-9a13-87e27730448c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:57.047571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-da5569d7-2d86-4a00-9a13-87e27730448c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:57.209991 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-735f43b1-a4f9-4e0b-a522-b674e3acccbb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:57.210761 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-735f43b1-a4f9-4e0b-a522-b674e3acccbb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:57.219851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-735f43b1-a4f9-4e0b-a522-b674e3acccbb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:57.220406 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-735f43b1-a4f9-4e0b-a522-b674e3acccbb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:57.221287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-735f43b1-a4f9-4e0b-a522-b674e3acccbb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:57.221784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-735f43b1-a4f9-4e0b-a522-b674e3acccbb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:57.304892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-da5569d7-2d86-4a00-9a13-87e27730448c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:57.310309 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:21:57.324514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-da5569d7-2d86-4a00-9a13-87e27730448c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.298242 Jun 23 08:21:57.325367 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 143/287] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:57 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:57.572201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-be31aaef-d9ab-4400-b7fb-dc33a9f70a9a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:57.573715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-be31aaef-d9ab-4400-b7fb-dc33a9f70a9a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:57.583276 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be31aaef-d9ab-4400-b7fb-dc33a9f70a9a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:57.583973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be31aaef-d9ab-4400-b7fb-dc33a9f70a9a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:57.585828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be31aaef-d9ab-4400-b7fb-dc33a9f70a9a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:57.585828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be31aaef-d9ab-4400-b7fb-dc33a9f70a9a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:57.668305 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-be31aaef-d9ab-4400-b7fb-dc33a9f70a9a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:57.677615 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-735f43b1-a4f9-4e0b-a522-b674e3acccbb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:57.678010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-be31aaef-d9ab-4400-b7fb-dc33a9f70a9a tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1512 microversion: 2.1 time: 0.118098 Jun 23 08:21:57.678665 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 144/288] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:57 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1512 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:57.697819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-735f43b1-a4f9-4e0b-a522-b674e3acccbb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.492848 Jun 23 08:21:57.698512 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 145/289] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:57 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:58.348539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b228a69c-d7d6-44cc-a617-551c6987fe29 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:58.349147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b228a69c-d7d6-44cc-a617-551c6987fe29 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:58.357466 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b228a69c-d7d6-44cc-a617-551c6987fe29 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:58.358752 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b228a69c-d7d6-44cc-a617-551c6987fe29 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:58.360302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b228a69c-d7d6-44cc-a617-551c6987fe29 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:58.361054 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b228a69c-d7d6-44cc-a617-551c6987fe29 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:58.515894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b228a69c-d7d6-44cc-a617-551c6987fe29 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:58.524176 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b228a69c-d7d6-44cc-a617-551c6987fe29 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.180800 Jun 23 08:21:58.524745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 145/290] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:58 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:58.702241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b5db9d49-a73d-49be-8377-7774a2b9119e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:58.702241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b5db9d49-a73d-49be-8377-7774a2b9119e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:58.708972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b5db9d49-a73d-49be-8377-7774a2b9119e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:58.709644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b5db9d49-a73d-49be-8377-7774a2b9119e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:58.710546 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b5db9d49-a73d-49be-8377-7774a2b9119e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:58.711118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b5db9d49-a73d-49be-8377-7774a2b9119e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:58.714615 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4a803524-9b30-4e83-a7fa-6a1defcd7952 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:58.715824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4a803524-9b30-4e83-a7fa-6a1defcd7952 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:58.723686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4a803524-9b30-4e83-a7fa-6a1defcd7952 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:58.724116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4a803524-9b30-4e83-a7fa-6a1defcd7952 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:58.725265 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4a803524-9b30-4e83-a7fa-6a1defcd7952 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:58.725723 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4a803524-9b30-4e83-a7fa-6a1defcd7952 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:58.824099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b5db9d49-a73d-49be-8377-7774a2b9119e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:58.838219 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b5db9d49-a73d-49be-8377-7774a2b9119e tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1512 microversion: 2.1 time: 0.146668 Jun 23 08:21:58.838806 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 146/291] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:58 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:58.903273 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4a803524-9b30-4e83-a7fa-6a1defcd7952 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:58.912066 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4a803524-9b30-4e83-a7fa-6a1defcd7952 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.201497 Jun 23 08:21:58.912649 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 146/292] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:58 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:21:59.540882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-207b8233-d080-4b7e-bd68-3c5778f98f2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:59.541651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-207b8233-d080-4b7e-bd68-3c5778f98f2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:59.548189 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-207b8233-d080-4b7e-bd68-3c5778f98f2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:59.548622 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-207b8233-d080-4b7e-bd68-3c5778f98f2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:59.549374 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-207b8233-d080-4b7e-bd68-3c5778f98f2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:59.550161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-207b8233-d080-4b7e-bd68-3c5778f98f2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:59.707273 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-207b8233-d080-4b7e-bd68-3c5778f98f2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:59.714989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-207b8233-d080-4b7e-bd68-3c5778f98f2a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.177987 Jun 23 08:21:59.715585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 147/293] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:59 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:21:59.855625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:59.862410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:59.868305 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:59.868735 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:59.869508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:59.869935 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:59.906030 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:59.906477 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:59.906933 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lazy-loading 'fault' on Instance uuid 621b2677-57b0-46a1-a540-efec39d1b018 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:21:59.932026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-80dc7ae2-8f4a-43ac-936e-51944d7277e9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:21:59.938435 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-80dc7ae2-8f4a-43ac-936e-51944d7277e9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:21:59.948770 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-80dc7ae2-8f4a-43ac-936e-51944d7277e9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:59.952494 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-80dc7ae2-8f4a-43ac-936e-51944d7277e9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:59.955249 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-80dc7ae2-8f4a-43ac-936e-51944d7277e9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:21:59.955757 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-80dc7ae2-8f4a-43ac-936e-51944d7277e9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:21:59.967660 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf926af634c4ec2ada5fc8f4aa95e07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2534820f9840f5b45a08bb2428be70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:21:59.976809 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-595eb7da-e725-4fc2-97ff-853bdc31d027 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 200 len: 1351 microversion: 2.1 time: 0.125246 Jun 23 08:21:59.978225 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 147/294] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:59 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:00.100700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-80dc7ae2-8f4a-43ac-936e-51944d7277e9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:00.108725 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-80dc7ae2-8f4a-43ac-936e-51944d7277e9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.180540 Jun 23 08:22:00.109306 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 148/295] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:21:59 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:00.732198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3d7c535f-152c-48e4-92db-d80e44575db7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:00.732941 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3d7c535f-152c-48e4-92db-d80e44575db7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:00.739534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d7c535f-152c-48e4-92db-d80e44575db7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:00.740102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d7c535f-152c-48e4-92db-d80e44575db7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:00.740948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d7c535f-152c-48e4-92db-d80e44575db7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:00.741500 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d7c535f-152c-48e4-92db-d80e44575db7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:00.878201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3d7c535f-152c-48e4-92db-d80e44575db7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:00.887850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3d7c535f-152c-48e4-92db-d80e44575db7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.159661 Jun 23 08:22:00.889160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 148/296] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:00 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:01.002488 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:01.004116 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:01.011938 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:01.012727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:01.013687 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:01.014257 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:01.029103 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] HTTP exception thrown: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Request method failure captured: Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 HTTP/1.1 Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJKh7bnYaqMGlWzY77nwlNbivpOvLg_h5p32Rgoe8KDyI4OnT9unC3yh8qFQsJPMgXUTh_x-o_yVMWKsF45sR9Ah-TQkWbVS375iSorBOGb9IwxATKnUU-Uph8g1pNU0_hXIVODignu5TvqIF1Ew5-kSqz4NhD05oZ2JQE9lDx7iwY Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 0e2534820f9840f5b45a08bb2428be70 Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:22:01.033822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e2534820f9840f5b45a08bb2428be70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e2534820f9840f5b45a08bb2428be70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e2534820f9840f5b45a08bb2428be70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e2534820f9840f5b45a08bb2428be70"}]}] Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 0e2534820f9840f5b45a08bb2428be70 Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-DeleteServersTestJSON-1602232290-project Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: eaf926af634c4ec2ada5fc8f4aa95e07 Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-DeleteServersTestJSON-1602232290-project Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.035318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '621b2677-57b0-46a1-a540-efec39d1b018'} Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:22:01.036251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.043570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Returning 404 to user: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:22:01.044776 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2987274b-7145-447f-b24f-37a2fb7b4c79 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 404 len: 111 microversion: 2.1 time: 0.048275 Jun 23 08:22:01.047324 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 149/297] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:00 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:22:01.126917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e84a78b9-517f-45f3-9170-1184a6236a85 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:01.127815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e84a78b9-517f-45f3-9170-1184a6236a85 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:01.134543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e84a78b9-517f-45f3-9170-1184a6236a85 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:01.139517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e84a78b9-517f-45f3-9170-1184a6236a85 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:01.140435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e84a78b9-517f-45f3-9170-1184a6236a85 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:01.141537 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e84a78b9-517f-45f3-9170-1184a6236a85 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:01.226975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:01.227955 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:01.234431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:01.235018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:01.235907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:01.236432 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:01.261611 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] HTTP exception thrown: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Request method failure captured: Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018/os-volume_attachments HTTP/1.1 Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJKh7bnYaqMGlWzY77nwlNbivpOvLg_h5p32Rgoe8KDyI4OnT9unC3yh8qFQsJPMgXUTh_x-o_yVMWKsF45sR9Ah-TQkWbVS375iSorBOGb9IwxATKnUU-Uph8g1pNU0_hXIVODignu5TvqIF1Ew5-kSqz4NhD05oZ2JQE9lDx7iwY Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 0e2534820f9840f5b45a08bb2428be70 Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:22:01.267340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e2534820f9840f5b45a08bb2428be70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e2534820f9840f5b45a08bb2428be70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e2534820f9840f5b45a08bb2428be70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e2534820f9840f5b45a08bb2428be70"}]}] Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 0e2534820f9840f5b45a08bb2428be70 Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-DeleteServersTestJSON-1602232290-project Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: eaf926af634c4ec2ada5fc8f4aa95e07 Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-DeleteServersTestJSON-1602232290-project Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.268892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'server_id': '621b2677-57b0-46a1-a540-efec39d1b018'} Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:22:01.269787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:01.271008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:01.272340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Returning 404 to user: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:22:01.274071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-72924615-019d-4ec6-9096-1afe5fa6afc5 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050155 Jun 23 08:22:01.274876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 150/298] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:22:01 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 08:22:01.293941 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e84a78b9-517f-45f3-9170-1184a6236a85 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:01.303590 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e84a78b9-517f-45f3-9170-1184a6236a85 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.181253 Jun 23 08:22:01.305027 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 149/299] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:01 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:01.906609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ef1c3f31-9696-4065-956e-ee3af1db9004 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:01.907243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ef1c3f31-9696-4065-956e-ee3af1db9004 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:01.916176 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ef1c3f31-9696-4065-956e-ee3af1db9004 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:01.916873 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ef1c3f31-9696-4065-956e-ee3af1db9004 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:01.917882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ef1c3f31-9696-4065-956e-ee3af1db9004 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:01.918511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ef1c3f31-9696-4065-956e-ee3af1db9004 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:02.056738 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ef1c3f31-9696-4065-956e-ee3af1db9004 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:02.065234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ef1c3f31-9696-4065-956e-ee3af1db9004 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.163490 Jun 23 08:22:02.065792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 151/300] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:01 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:02.322127 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f83179b7-1ede-40c1-9313-3041d5bcdbe5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:02.322739 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f83179b7-1ede-40c1-9313-3041d5bcdbe5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:02.329741 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f83179b7-1ede-40c1-9313-3041d5bcdbe5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:02.330239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f83179b7-1ede-40c1-9313-3041d5bcdbe5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:02.331017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f83179b7-1ede-40c1-9313-3041d5bcdbe5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:02.331479 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f83179b7-1ede-40c1-9313-3041d5bcdbe5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:02.473711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f83179b7-1ede-40c1-9313-3041d5bcdbe5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:02.481449 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f83179b7-1ede-40c1-9313-3041d5bcdbe5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.163171 Jun 23 08:22:02.482483 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 150/301] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:02 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:02.533940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-dee87f56-877c-4778-8f27-1445e55ae5b2 req-84fab720-c2ac-44fe-962f-cf9e9cba7803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c73899-1dfd-4ce2-b988-681df43ef5e6", "name": "network-vif-plugged", "status": "completed", "tag": "b573fb6b-6e0a-4c90-ab3c-be2c12dcf1ad"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:02.547313 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-dee87f56-877c-4778-8f27-1445e55ae5b2 req-84fab720-c2ac-44fe-962f-cf9e9cba7803 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:02.547950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-dee87f56-877c-4778-8f27-1445e55ae5b2 req-84fab720-c2ac-44fe-962f-cf9e9cba7803 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:02.560954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-dee87f56-877c-4778-8f27-1445e55ae5b2 req-84fab720-c2ac-44fe-962f-cf9e9cba7803 service nova] Creating event network-vif-plugged:b573fb6b-6e0a-4c90-ab3c-be2c12dcf1ad for instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 on hv-cinder-84721 Jun 23 08:22:02.567247 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-dee87f56-877c-4778-8f27-1445e55ae5b2 req-84fab720-c2ac-44fe-962f-cf9e9cba7803 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038805 Jun 23 08:22:02.568434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 152/302] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:22:02.619760 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:02.620452 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:02.630334 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:02.630828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:02.631715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:02.632141 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:02.648496 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] HTTP exception thrown: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Request method failure captured: Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 HTTP/1.1 Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJKh7bnYaqMGlWzY77nwlNbivpOvLg_h5p32Rgoe8KDyI4OnT9unC3yh8qFQsJPMgXUTh_x-o_yVMWKsF45sR9Ah-TQkWbVS375iSorBOGb9IwxATKnUU-Uph8g1pNU0_hXIVODignu5TvqIF1Ew5-kSqz4NhD05oZ2JQE9lDx7iwY Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 0e2534820f9840f5b45a08bb2428be70 Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:22:02.653045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e2534820f9840f5b45a08bb2428be70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e2534820f9840f5b45a08bb2428be70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e2534820f9840f5b45a08bb2428be70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e2534820f9840f5b45a08bb2428be70"}]}] Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 0e2534820f9840f5b45a08bb2428be70 Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-DeleteServersTestJSON-1602232290-project Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: eaf926af634c4ec2ada5fc8f4aa95e07 Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-DeleteServersTestJSON-1602232290-project Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.655324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '621b2677-57b0-46a1-a540-efec39d1b018'} Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:22:02.655983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.657048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.658264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Returning 404 to user: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:22:02.658264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5166a09b-f43b-412c-90ef-672101f912bc tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "DELETE /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 404 len: 111 microversion: 2.1 time: 0.039916 Jun 23 08:22:02.658264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 151/303] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:22:02 2022] DELETE /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:22:02.665101 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:02.665781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] [instance: 621b2677-57b0-46a1-a540-efec39d1b018] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:02.672375 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:02.672816 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:02.673567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:02.674125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:02.688147 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] HTTP exception thrown: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Request method failure captured: Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 HTTP/1.1 Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJKh7bnYaqMGlWzY77nwlNbivpOvLg_h5p32Rgoe8KDyI4OnT9unC3yh8qFQsJPMgXUTh_x-o_yVMWKsF45sR9Ah-TQkWbVS375iSorBOGb9IwxATKnUU-Uph8g1pNU0_hXIVODignu5TvqIF1Ew5-kSqz4NhD05oZ2JQE9lDx7iwY Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 0e2534820f9840f5b45a08bb2428be70 Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:22:02.689924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e2534820f9840f5b45a08bb2428be70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e2534820f9840f5b45a08bb2428be70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e2534820f9840f5b45a08bb2428be70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e2534820f9840f5b45a08bb2428be70"}]}] Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 0e2534820f9840f5b45a08bb2428be70 Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-DeleteServersTestJSON-1602232290 Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-DeleteServersTestJSON-1602232290-project Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: eaf926af634c4ec2ada5fc8f4aa95e07 Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-DeleteServersTestJSON-1602232290-project Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.691263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '621b2677-57b0-46a1-a540-efec39d1b018'} Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:22:02.692296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. Jun 23 08:22:02.693348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:22:02.694298 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] Returning 404 to user: Instance 621b2677-57b0-46a1-a540-efec39d1b018 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:22:02.694298 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b92921c6-ef02-48de-998f-fea7db7522d9 tempest-DeleteServersTestJSON-1602232290 tempest-DeleteServersTestJSON-1602232290-project] 10.222.0.33 "GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018" status: 404 len: 111 microversion: 2.1 time: 0.033838 Jun 23 08:22:02.697991 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 153/304] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:02 2022] GET /compute/v2.1/servers/621b2677-57b0-46a1-a540-efec39d1b018 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 08:22:03.081982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-399bab4a-ff46-4b66-b7eb-834fa9a8ca3a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:03.082577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-399bab4a-ff46-4b66-b7eb-834fa9a8ca3a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:03.098663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-399bab4a-ff46-4b66-b7eb-834fa9a8ca3a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:03.101157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-399bab4a-ff46-4b66-b7eb-834fa9a8ca3a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:03.102302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-399bab4a-ff46-4b66-b7eb-834fa9a8ca3a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:03.102931 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-399bab4a-ff46-4b66-b7eb-834fa9a8ca3a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:03.288011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-399bab4a-ff46-4b66-b7eb-834fa9a8ca3a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:03.302986 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-399bab4a-ff46-4b66-b7eb-834fa9a8ca3a tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.224858 Jun 23 08:22:03.307044 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 152/305] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:03 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:03.501787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-34d5d006-b7ff-492f-985e-c915d049a6a3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:03.503147 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-34d5d006-b7ff-492f-985e-c915d049a6a3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:03.509970 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-34d5d006-b7ff-492f-985e-c915d049a6a3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:03.512519 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-34d5d006-b7ff-492f-985e-c915d049a6a3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:03.513359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-34d5d006-b7ff-492f-985e-c915d049a6a3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:03.514073 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-34d5d006-b7ff-492f-985e-c915d049a6a3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:03.519113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:03.736610 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-34d5d006-b7ff-492f-985e-c915d049a6a3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:03.744536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-34d5d006-b7ff-492f-985e-c915d049a6a3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.248109 Jun 23 08:22:03.745353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 154/306] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:03 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:04.324662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-acca9b0b-6b90-4185-87f2-daa4180eb7e7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:04.325934 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-acca9b0b-6b90-4185-87f2-daa4180eb7e7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:04.334886 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-acca9b0b-6b90-4185-87f2-daa4180eb7e7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:04.335646 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-acca9b0b-6b90-4185-87f2-daa4180eb7e7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:04.337110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-acca9b0b-6b90-4185-87f2-daa4180eb7e7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:04.337812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-acca9b0b-6b90-4185-87f2-daa4180eb7e7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:04.558028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-acca9b0b-6b90-4185-87f2-daa4180eb7e7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:04.570570 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-acca9b0b-6b90-4185-87f2-daa4180eb7e7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1319 microversion: 2.1 time: 0.249433 Jun 23 08:22:04.571333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 153/307] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:04 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:04.761995 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-af09732d-675e-45cb-8271-a687b5ceb39a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:04.762604 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-af09732d-675e-45cb-8271-a687b5ceb39a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:04.773041 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-af09732d-675e-45cb-8271-a687b5ceb39a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:04.775467 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-af09732d-675e-45cb-8271-a687b5ceb39a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:04.779348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-af09732d-675e-45cb-8271-a687b5ceb39a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:04.780268 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-af09732d-675e-45cb-8271-a687b5ceb39a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:04.965734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-af09732d-675e-45cb-8271-a687b5ceb39a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:04.978318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-af09732d-675e-45cb-8271-a687b5ceb39a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.220241 Jun 23 08:22:04.979257 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 155/308] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:04 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:05.592110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-653c1d97-9f6d-4712-899d-e064647c9dbb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:05.593566 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-653c1d97-9f6d-4712-899d-e064647c9dbb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:05.616112 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-653c1d97-9f6d-4712-899d-e064647c9dbb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:05.616664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-653c1d97-9f6d-4712-899d-e064647c9dbb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:05.619276 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-653c1d97-9f6d-4712-899d-e064647c9dbb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:05.619726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-653c1d97-9f6d-4712-899d-e064647c9dbb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:05.836951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-653c1d97-9f6d-4712-899d-e064647c9dbb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:05.845888 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-653c1d97-9f6d-4712-899d-e064647c9dbb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1508 microversion: 2.1 time: 0.261368 Jun 23 08:22:05.846986 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 154/309] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:05 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:05.995860 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-fa933d64-b7c9-447b-9d5c-0fc6dfe2fc2b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:05.996483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-fa933d64-b7c9-447b-9d5c-0fc6dfe2fc2b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:06.019334 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fa933d64-b7c9-447b-9d5c-0fc6dfe2fc2b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:06.019702 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fa933d64-b7c9-447b-9d5c-0fc6dfe2fc2b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:06.020475 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fa933d64-b7c9-447b-9d5c-0fc6dfe2fc2b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:06.020914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fa933d64-b7c9-447b-9d5c-0fc6dfe2fc2b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:06.294013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fa933d64-b7c9-447b-9d5c-0fc6dfe2fc2b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:06.304572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-fa933d64-b7c9-447b-9d5c-0fc6dfe2fc2b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.312387 Jun 23 08:22:06.305143 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 156/310] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:05 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:07.323875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ef0cd1d4-73d8-4047-aa17-6bef76a14ebe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:07.325725 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ef0cd1d4-73d8-4047-aa17-6bef76a14ebe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:07.332411 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ef0cd1d4-73d8-4047-aa17-6bef76a14ebe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:07.333086 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ef0cd1d4-73d8-4047-aa17-6bef76a14ebe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:07.333861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ef0cd1d4-73d8-4047-aa17-6bef76a14ebe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:07.334298 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ef0cd1d4-73d8-4047-aa17-6bef76a14ebe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:07.539080 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ef0cd1d4-73d8-4047-aa17-6bef76a14ebe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:07.555789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ef0cd1d4-73d8-4047-aa17-6bef76a14ebe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.231743 Jun 23 08:22:07.557092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 155/311] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:07 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:08.573804 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bbdd0cb8-78a8-4268-839f-9568f9655e31 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:08.575228 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bbdd0cb8-78a8-4268-839f-9568f9655e31 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:08.579258 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=78 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:08.588947 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bbdd0cb8-78a8-4268-839f-9568f9655e31 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:08.589673 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bbdd0cb8-78a8-4268-839f-9568f9655e31 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:08.590661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bbdd0cb8-78a8-4268-839f-9568f9655e31 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:08.599676 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bbdd0cb8-78a8-4268-839f-9568f9655e31 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:08.875817 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bbdd0cb8-78a8-4268-839f-9568f9655e31 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:08.897924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bbdd0cb8-78a8-4268-839f-9568f9655e31 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.328187 Jun 23 08:22:08.898919 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 157/312] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:08 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:09.923484 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ff932883-8ee4-4116-bbfe-b159751bfd79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:09.925178 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ff932883-8ee4-4116-bbfe-b159751bfd79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:09.933557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff932883-8ee4-4116-bbfe-b159751bfd79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:09.934211 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff932883-8ee4-4116-bbfe-b159751bfd79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:09.935663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff932883-8ee4-4116-bbfe-b159751bfd79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:09.936269 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff932883-8ee4-4116-bbfe-b159751bfd79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:10.311799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ff932883-8ee4-4116-bbfe-b159751bfd79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:10.324126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ff932883-8ee4-4116-bbfe-b159751bfd79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.412822 Jun 23 08:22:10.325821 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 156/313] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:09 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:11.342570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6978ee85-6ca8-430d-a1f7-11e1bcbd26f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:11.343461 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6978ee85-6ca8-430d-a1f7-11e1bcbd26f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:11.349511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6978ee85-6ca8-430d-a1f7-11e1bcbd26f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:11.350255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6978ee85-6ca8-430d-a1f7-11e1bcbd26f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:11.351186 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6978ee85-6ca8-430d-a1f7-11e1bcbd26f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:11.351786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6978ee85-6ca8-430d-a1f7-11e1bcbd26f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:11.548541 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6978ee85-6ca8-430d-a1f7-11e1bcbd26f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:11.556545 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6978ee85-6ca8-430d-a1f7-11e1bcbd26f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.218468 Jun 23 08:22:11.557115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 158/314] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:11 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:12.574726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3b02a511-8389-4005-8927-2a0a85197b9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:12.577296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3b02a511-8389-4005-8927-2a0a85197b9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:12.585455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b02a511-8389-4005-8927-2a0a85197b9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:12.586103 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b02a511-8389-4005-8927-2a0a85197b9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:12.587062 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b02a511-8389-4005-8927-2a0a85197b9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:12.587695 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3b02a511-8389-4005-8927-2a0a85197b9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:12.773530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3b02a511-8389-4005-8927-2a0a85197b9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:12.781485 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3b02a511-8389-4005-8927-2a0a85197b9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.211659 Jun 23 08:22:12.782146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 157/315] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:12 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:13.047060 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-445632741", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "networks": [{"uuid": "b2d7a7e3-fb45-488f-8154-a48a9bf069c7"}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:13.105512 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] validate_networks() for [('b2d7a7e3-fb45-488f-8154-a48a9bf069c7', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:22:13.506931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:22:13.507374 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:22:13.507815 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:22:13.508235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:22:13.508613 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:22:13.518127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:13.518565 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:13.519523 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:13.519948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:13.541198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Getting quotas for project ad9e87cb4bc84ff294c69c2e54704c33. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:22:13.545266 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Getting quotas for user 2821263e860a449eb4472ed2c4203e20 and project ad9e87cb4bc84ff294c69c2e54704c33. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:22:13.557122 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:22:13.559661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:22:13.608589 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3678bfa6-9460-44d4-9085-463063e4a469 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567857 Jun 23 08:22:13.609236 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 159/316] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:22:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 08:22:13.628584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-31918a21-734e-474f-a0d2-d29b71557687 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:13.629182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-31918a21-734e-474f-a0d2-d29b71557687 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:13.696206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-31918a21-734e-474f-a0d2-d29b71557687 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:13.704496 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-31918a21-734e-474f-a0d2-d29b71557687 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1213 microversion: 2.1 time: 0.079663 Jun 23 08:22:13.705182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 158/317] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:13 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:13.802396 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8912f3b4-2250-46d5-81f4-2c6be6c7b696 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:13.803017 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8912f3b4-2250-46d5-81f4-2c6be6c7b696 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:13.809787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8912f3b4-2250-46d5-81f4-2c6be6c7b696 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:13.810287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8912f3b4-2250-46d5-81f4-2c6be6c7b696 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:13.811094 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8912f3b4-2250-46d5-81f4-2c6be6c7b696 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:13.811738 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8912f3b4-2250-46d5-81f4-2c6be6c7b696 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:13.971982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8912f3b4-2250-46d5-81f4-2c6be6c7b696 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:13.980584 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8912f3b4-2250-46d5-81f4-2c6be6c7b696 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.184326 Jun 23 08:22:13.988533 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 160/318] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:13 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:22:14.721211 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-39c158ef-1ce9-439c-a765-a9d0e23a5da2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:14.722115 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-39c158ef-1ce9-439c-a765-a9d0e23a5da2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:14.729552 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-39c158ef-1ce9-439c-a765-a9d0e23a5da2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:14.730024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-39c158ef-1ce9-439c-a765-a9d0e23a5da2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:14.730956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-39c158ef-1ce9-439c-a765-a9d0e23a5da2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:14.731427 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-39c158ef-1ce9-439c-a765-a9d0e23a5da2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:14.813657 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-39c158ef-1ce9-439c-a765-a9d0e23a5da2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:14.839096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-39c158ef-1ce9-439c-a765-a9d0e23a5da2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1265 microversion: 2.1 time: 0.120821 Jun 23 08:22:14.850590 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 159/319] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:14 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:14.998948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4d7f33fd-1419-4c4b-ad4b-d7a3d73d39bb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:15.000446 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4d7f33fd-1419-4c4b-ad4b-d7a3d73d39bb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:15.009642 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4d7f33fd-1419-4c4b-ad4b-d7a3d73d39bb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:15.010564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4d7f33fd-1419-4c4b-ad4b-d7a3d73d39bb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:15.011524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4d7f33fd-1419-4c4b-ad4b-d7a3d73d39bb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:15.012132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4d7f33fd-1419-4c4b-ad4b-d7a3d73d39bb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:15.259890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4d7f33fd-1419-4c4b-ad4b-d7a3d73d39bb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:15.269904 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4d7f33fd-1419-4c4b-ad4b-d7a3d73d39bb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.275871 Jun 23 08:22:15.270492 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 161/320] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:14 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:15.859076 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-312bc399-7451-464c-83aa-f0f4992ba52f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:15.860507 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-312bc399-7451-464c-83aa-f0f4992ba52f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:15.884581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-312bc399-7451-464c-83aa-f0f4992ba52f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:15.885349 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-312bc399-7451-464c-83aa-f0f4992ba52f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:15.891084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-312bc399-7451-464c-83aa-f0f4992ba52f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:15.891860 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-312bc399-7451-464c-83aa-f0f4992ba52f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:16.068804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-312bc399-7451-464c-83aa-f0f4992ba52f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:16.078340 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-312bc399-7451-464c-83aa-f0f4992ba52f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.223753 Jun 23 08:22:16.079102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 160/321] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:15 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:16.287974 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7cb13e2c-ca93-4a33-96bb-ab9ff014ce2f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:16.289388 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7cb13e2c-ca93-4a33-96bb-ab9ff014ce2f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:16.295921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7cb13e2c-ca93-4a33-96bb-ab9ff014ce2f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:16.296363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7cb13e2c-ca93-4a33-96bb-ab9ff014ce2f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:16.297501 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7cb13e2c-ca93-4a33-96bb-ab9ff014ce2f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:16.298056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7cb13e2c-ca93-4a33-96bb-ab9ff014ce2f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:16.342090 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-c4ffcbbd-676b-4580-ae6a-93669e88885e req-74ab67a1-a7a7-4eeb-868a-da96199ddb33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd6acd4-3db6-42bd-9ddf-d36044988fa8", "tag": "a47687d5-476a-4f0d-a81f-dc7638c31c20"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:16.354218 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c4ffcbbd-676b-4580-ae6a-93669e88885e req-74ab67a1-a7a7-4eeb-868a-da96199ddb33 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:16.354678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c4ffcbbd-676b-4580-ae6a-93669e88885e req-74ab67a1-a7a7-4eeb-868a-da96199ddb33 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:16.369417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-c4ffcbbd-676b-4580-ae6a-93669e88885e req-74ab67a1-a7a7-4eeb-868a-da96199ddb33 service nova] Creating event network-changed:a47687d5-476a-4f0d-a81f-dc7638c31c20 for instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 on hv-cinder-84721 Jun 23 08:22:16.375838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-c4ffcbbd-676b-4580-ae6a-93669e88885e req-74ab67a1-a7a7-4eeb-868a-da96199ddb33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038574 Jun 23 08:22:16.376445 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 161/322] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:22:16.704202 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7cb13e2c-ca93-4a33-96bb-ab9ff014ce2f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:16.712224 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7cb13e2c-ca93-4a33-96bb-ab9ff014ce2f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.428678 Jun 23 08:22:16.713027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 162/323] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:16 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:22:17.096222 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a00e888f-b387-4e90-854b-81b4175ca275 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:17.097007 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a00e888f-b387-4e90-854b-81b4175ca275 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:17.099123 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:17.108167 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a00e888f-b387-4e90-854b-81b4175ca275 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:17.108704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a00e888f-b387-4e90-854b-81b4175ca275 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:17.109542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a00e888f-b387-4e90-854b-81b4175ca275 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:17.110210 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a00e888f-b387-4e90-854b-81b4175ca275 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:17.130438 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:17.258605 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a00e888f-b387-4e90-854b-81b4175ca275 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:17.266605 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a00e888f-b387-4e90-854b-81b4175ca275 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.175738 Jun 23 08:22:17.267743 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 162/324] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:17 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:17.729915 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a74329eb-18a1-448a-a4fe-35cff9e31800 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:17.730552 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a74329eb-18a1-448a-a4fe-35cff9e31800 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:17.737638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a74329eb-18a1-448a-a4fe-35cff9e31800 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:17.738076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a74329eb-18a1-448a-a4fe-35cff9e31800 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:17.738888 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a74329eb-18a1-448a-a4fe-35cff9e31800 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:17.739362 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a74329eb-18a1-448a-a4fe-35cff9e31800 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:17.884437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a74329eb-18a1-448a-a4fe-35cff9e31800 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:17.894844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a74329eb-18a1-448a-a4fe-35cff9e31800 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.168556 Jun 23 08:22:17.896078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 163/325] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:17 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:18.283841 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9fcc83d8-b912-4cc0-ad9d-2069ad119448 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:18.284485 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9fcc83d8-b912-4cc0-ad9d-2069ad119448 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:18.291171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9fcc83d8-b912-4cc0-ad9d-2069ad119448 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:18.291838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9fcc83d8-b912-4cc0-ad9d-2069ad119448 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:18.292609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9fcc83d8-b912-4cc0-ad9d-2069ad119448 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:18.293046 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9fcc83d8-b912-4cc0-ad9d-2069ad119448 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:18.484174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9fcc83d8-b912-4cc0-ad9d-2069ad119448 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:18.493424 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9fcc83d8-b912-4cc0-ad9d-2069ad119448 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.213595 Jun 23 08:22:18.494067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 163/326] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:18 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:18.912078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4aec4810-dd7f-4033-8147-e509f9a85247 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:18.912616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4aec4810-dd7f-4033-8147-e509f9a85247 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:18.918682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4aec4810-dd7f-4033-8147-e509f9a85247 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:18.919178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4aec4810-dd7f-4033-8147-e509f9a85247 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:18.920291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4aec4810-dd7f-4033-8147-e509f9a85247 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:18.920723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4aec4810-dd7f-4033-8147-e509f9a85247 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:19.069558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4aec4810-dd7f-4033-8147-e509f9a85247 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:19.078246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4aec4810-dd7f-4033-8147-e509f9a85247 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.170044 Jun 23 08:22:19.079131 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 164/327] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:18 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:22:19.511431 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-fe8d6f8f-9d3f-4e4e-b1ae-ec314e03779e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:19.511945 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-fe8d6f8f-9d3f-4e4e-b1ae-ec314e03779e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:19.518539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fe8d6f8f-9d3f-4e4e-b1ae-ec314e03779e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:19.518976 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fe8d6f8f-9d3f-4e4e-b1ae-ec314e03779e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:19.519775 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fe8d6f8f-9d3f-4e4e-b1ae-ec314e03779e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:19.520187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fe8d6f8f-9d3f-4e4e-b1ae-ec314e03779e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:19.658412 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-fe8d6f8f-9d3f-4e4e-b1ae-ec314e03779e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:19.665993 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-fe8d6f8f-9d3f-4e4e-b1ae-ec314e03779e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.158982 Jun 23 08:22:19.666548 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 164/328] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:19 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:20.096029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e1f1de4f-77c0-4433-9a0a-c90a312452a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:20.096577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e1f1de4f-77c0-4433-9a0a-c90a312452a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:20.102995 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e1f1de4f-77c0-4433-9a0a-c90a312452a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:20.103473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e1f1de4f-77c0-4433-9a0a-c90a312452a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:20.104235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e1f1de4f-77c0-4433-9a0a-c90a312452a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:20.104668 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e1f1de4f-77c0-4433-9a0a-c90a312452a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:20.240383 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e1f1de4f-77c0-4433-9a0a-c90a312452a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:20.252020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e1f1de4f-77c0-4433-9a0a-c90a312452a1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.159702 Jun 23 08:22:20.252772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 165/329] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:20 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:20.686963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-daf5a79e-6dd5-4696-817e-4bc6ca784b12 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:20.687854 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-daf5a79e-6dd5-4696-817e-4bc6ca784b12 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:20.696276 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-daf5a79e-6dd5-4696-817e-4bc6ca784b12 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:20.696804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-daf5a79e-6dd5-4696-817e-4bc6ca784b12 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:20.697717 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-daf5a79e-6dd5-4696-817e-4bc6ca784b12 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:20.698218 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-daf5a79e-6dd5-4696-817e-4bc6ca784b12 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:20.833995 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-daf5a79e-6dd5-4696-817e-4bc6ca784b12 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:20.841968 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-daf5a79e-6dd5-4696-817e-4bc6ca784b12 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.160969 Jun 23 08:22:20.842767 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 165/330] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:20 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:21.268657 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d87735a3-56c4-4322-9004-f193783d0741 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:21.269371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d87735a3-56c4-4322-9004-f193783d0741 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:21.275502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d87735a3-56c4-4322-9004-f193783d0741 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:21.275936 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d87735a3-56c4-4322-9004-f193783d0741 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:21.276690 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d87735a3-56c4-4322-9004-f193783d0741 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:21.277110 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d87735a3-56c4-4322-9004-f193783d0741 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:21.414383 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d87735a3-56c4-4322-9004-f193783d0741 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:21.422774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d87735a3-56c4-4322-9004-f193783d0741 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.157905 Jun 23 08:22:21.423285 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 166/331] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:21 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:21.858398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3fe67215-40c1-4cdb-aaca-7113d3de4e0e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:21.859029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3fe67215-40c1-4cdb-aaca-7113d3de4e0e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:21.865918 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3fe67215-40c1-4cdb-aaca-7113d3de4e0e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:21.866463 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3fe67215-40c1-4cdb-aaca-7113d3de4e0e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:21.867279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3fe67215-40c1-4cdb-aaca-7113d3de4e0e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:21.867708 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3fe67215-40c1-4cdb-aaca-7113d3de4e0e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:22.005002 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3fe67215-40c1-4cdb-aaca-7113d3de4e0e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:22.012685 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3fe67215-40c1-4cdb-aaca-7113d3de4e0e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.158579 Jun 23 08:22:22.013235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 166/332] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:21 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:22.444889 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ad5858aa-2b45-44f7-9446-8c1ed118e9b4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:22.445872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ad5858aa-2b45-44f7-9446-8c1ed118e9b4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:22.455680 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ad5858aa-2b45-44f7-9446-8c1ed118e9b4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:22.456123 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ad5858aa-2b45-44f7-9446-8c1ed118e9b4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:22.456901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ad5858aa-2b45-44f7-9446-8c1ed118e9b4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:22.457334 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ad5858aa-2b45-44f7-9446-8c1ed118e9b4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:22.601407 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ad5858aa-2b45-44f7-9446-8c1ed118e9b4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:22.609014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ad5858aa-2b45-44f7-9446-8c1ed118e9b4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.170994 Jun 23 08:22:22.609598 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 167/333] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:22 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:22:23.032117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e2bb06e6-c14b-494d-b09e-feb7fe4f1361 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:23.032739 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e2bb06e6-c14b-494d-b09e-feb7fe4f1361 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:23.040788 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e2bb06e6-c14b-494d-b09e-feb7fe4f1361 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:23.041213 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e2bb06e6-c14b-494d-b09e-feb7fe4f1361 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:23.042072 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e2bb06e6-c14b-494d-b09e-feb7fe4f1361 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:23.042507 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e2bb06e6-c14b-494d-b09e-feb7fe4f1361 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:23.179240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e2bb06e6-c14b-494d-b09e-feb7fe4f1361 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:23.189716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e2bb06e6-c14b-494d-b09e-feb7fe4f1361 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.163591 Jun 23 08:22:23.190297 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 167/334] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:23 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:23.631494 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4db038e5-219c-4ec8-af58-574669ca21cb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:23.632066 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4db038e5-219c-4ec8-af58-574669ca21cb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:23.634140 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:23.634791 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:23.643599 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4db038e5-219c-4ec8-af58-574669ca21cb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:23.644153 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4db038e5-219c-4ec8-af58-574669ca21cb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:23.644933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4db038e5-219c-4ec8-af58-574669ca21cb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:23.645461 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4db038e5-219c-4ec8-af58-574669ca21cb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:23.790943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4db038e5-219c-4ec8-af58-574669ca21cb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:23.800119 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4db038e5-219c-4ec8-af58-574669ca21cb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.172479 Jun 23 08:22:23.801029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 168/335] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:23 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:24.206707 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6b3a766b-7a30-473b-b9dc-0c895c2bb183 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:24.207304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6b3a766b-7a30-473b-b9dc-0c895c2bb183 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:24.209214 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:24.215237 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b3a766b-7a30-473b-b9dc-0c895c2bb183 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:24.215687 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b3a766b-7a30-473b-b9dc-0c895c2bb183 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:24.216455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b3a766b-7a30-473b-b9dc-0c895c2bb183 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:24.216889 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b3a766b-7a30-473b-b9dc-0c895c2bb183 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:24.355005 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6b3a766b-7a30-473b-b9dc-0c895c2bb183 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:24.366541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6b3a766b-7a30-473b-b9dc-0c895c2bb183 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.163614 Jun 23 08:22:24.367192 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 168/336] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:24 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:24.818494 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7ff4e05c-fc11-4d50-88b5-2a73af2d1f79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:24.819097 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7ff4e05c-fc11-4d50-88b5-2a73af2d1f79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:24.825584 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7ff4e05c-fc11-4d50-88b5-2a73af2d1f79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:24.826025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7ff4e05c-fc11-4d50-88b5-2a73af2d1f79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:24.827056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7ff4e05c-fc11-4d50-88b5-2a73af2d1f79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:24.827648 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7ff4e05c-fc11-4d50-88b5-2a73af2d1f79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:24.959342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7ff4e05c-fc11-4d50-88b5-2a73af2d1f79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:24.967072 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7ff4e05c-fc11-4d50-88b5-2a73af2d1f79 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.152434 Jun 23 08:22:24.967844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 169/337] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:24 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:25.385963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c9c9e776-3929-4666-ad8e-35562669c1e8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:25.386548 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c9c9e776-3929-4666-ad8e-35562669c1e8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:25.393484 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c9c9e776-3929-4666-ad8e-35562669c1e8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:25.393922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c9c9e776-3929-4666-ad8e-35562669c1e8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:25.394667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c9c9e776-3929-4666-ad8e-35562669c1e8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:25.395090 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c9c9e776-3929-4666-ad8e-35562669c1e8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:25.536767 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c9c9e776-3929-4666-ad8e-35562669c1e8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:25.544717 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c9c9e776-3929-4666-ad8e-35562669c1e8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.162776 Jun 23 08:22:25.545457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 169/338] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:25 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:25.986281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-93378db9-4880-418a-ac73-ce7b2e15f1ef tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:25.986894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-93378db9-4880-418a-ac73-ce7b2e15f1ef tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:25.993106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-93378db9-4880-418a-ac73-ce7b2e15f1ef tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:25.993548 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-93378db9-4880-418a-ac73-ce7b2e15f1ef tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:25.994310 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-93378db9-4880-418a-ac73-ce7b2e15f1ef tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:25.994735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-93378db9-4880-418a-ac73-ce7b2e15f1ef tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:26.142243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-93378db9-4880-418a-ac73-ce7b2e15f1ef tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:26.154749 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-93378db9-4880-418a-ac73-ce7b2e15f1ef tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.171905 Jun 23 08:22:26.155997 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 170/339] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:25 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:26.562101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e8a1447b-4625-40d1-b47b-e51214364e58 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:26.562739 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e8a1447b-4625-40d1-b47b-e51214364e58 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:26.572002 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e8a1447b-4625-40d1-b47b-e51214364e58 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:26.572486 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e8a1447b-4625-40d1-b47b-e51214364e58 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:26.573279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e8a1447b-4625-40d1-b47b-e51214364e58 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:26.573705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e8a1447b-4625-40d1-b47b-e51214364e58 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:26.715861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e8a1447b-4625-40d1-b47b-e51214364e58 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:26.725218 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e8a1447b-4625-40d1-b47b-e51214364e58 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.166957 Jun 23 08:22:26.725790 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 170/340] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:26 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:27.177741 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f34c6266-1bd0-4584-b3f4-1b89c48d9c1a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:27.178799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f34c6266-1bd0-4584-b3f4-1b89c48d9c1a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:27.185514 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f34c6266-1bd0-4584-b3f4-1b89c48d9c1a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:27.185974 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f34c6266-1bd0-4584-b3f4-1b89c48d9c1a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:27.186745 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f34c6266-1bd0-4584-b3f4-1b89c48d9c1a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:27.187179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f34c6266-1bd0-4584-b3f4-1b89c48d9c1a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:27.207026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:27.441560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f34c6266-1bd0-4584-b3f4-1b89c48d9c1a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:27.449525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f34c6266-1bd0-4584-b3f4-1b89c48d9c1a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.276228 Jun 23 08:22:27.450092 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 171/341] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:27 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:27.745157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e34ab117-9cd8-4a95-a20f-c36c7827187c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:27.746124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e34ab117-9cd8-4a95-a20f-c36c7827187c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:27.756902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e34ab117-9cd8-4a95-a20f-c36c7827187c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:27.757672 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e34ab117-9cd8-4a95-a20f-c36c7827187c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:27.758851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e34ab117-9cd8-4a95-a20f-c36c7827187c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:27.759572 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e34ab117-9cd8-4a95-a20f-c36c7827187c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:27.904619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e34ab117-9cd8-4a95-a20f-c36c7827187c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:27.912638 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e34ab117-9cd8-4a95-a20f-c36c7827187c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.173709 Jun 23 08:22:27.913206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 171/342] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:27 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:28.467111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9739d6d5-2456-4caf-a26c-661f15095a54 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:28.467739 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9739d6d5-2456-4caf-a26c-661f15095a54 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:28.473927 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9739d6d5-2456-4caf-a26c-661f15095a54 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:28.474366 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9739d6d5-2456-4caf-a26c-661f15095a54 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:28.475115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9739d6d5-2456-4caf-a26c-661f15095a54 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:28.475576 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9739d6d5-2456-4caf-a26c-661f15095a54 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:28.698945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9739d6d5-2456-4caf-a26c-661f15095a54 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:28.707455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9739d6d5-2456-4caf-a26c-661f15095a54 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.244122 Jun 23 08:22:28.708141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 172/343] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:28 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:28.930427 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7d4bc802-7ecf-40ac-b06a-0bf3e0ea42a4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:28.931011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7d4bc802-7ecf-40ac-b06a-0bf3e0ea42a4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:28.938783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7d4bc802-7ecf-40ac-b06a-0bf3e0ea42a4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:28.939242 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7d4bc802-7ecf-40ac-b06a-0bf3e0ea42a4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:28.940653 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7d4bc802-7ecf-40ac-b06a-0bf3e0ea42a4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:28.941101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7d4bc802-7ecf-40ac-b06a-0bf3e0ea42a4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:29.076895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7d4bc802-7ecf-40ac-b06a-0bf3e0ea42a4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:29.085226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7d4bc802-7ecf-40ac-b06a-0bf3e0ea42a4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.158826 Jun 23 08:22:29.085824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 172/344] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:28 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:22:29.725443 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-da29e7a4-9754-43cd-8b49-125a2ebc1405 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:29.726053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-da29e7a4-9754-43cd-8b49-125a2ebc1405 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:29.732294 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-da29e7a4-9754-43cd-8b49-125a2ebc1405 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:29.732737 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-da29e7a4-9754-43cd-8b49-125a2ebc1405 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:29.733486 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-da29e7a4-9754-43cd-8b49-125a2ebc1405 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:29.733922 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-da29e7a4-9754-43cd-8b49-125a2ebc1405 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:29.867342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-da29e7a4-9754-43cd-8b49-125a2ebc1405 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:29.878225 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-da29e7a4-9754-43cd-8b49-125a2ebc1405 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1521 microversion: 2.1 time: 0.156738 Jun 23 08:22:29.879131 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 173/345] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:29 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:30.106244 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3c5fe09e-2f79-4181-9788-2b8402d089bf tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:30.107254 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3c5fe09e-2f79-4181-9788-2b8402d089bf tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:30.116593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3c5fe09e-2f79-4181-9788-2b8402d089bf tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:30.117033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3c5fe09e-2f79-4181-9788-2b8402d089bf tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:30.117786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3c5fe09e-2f79-4181-9788-2b8402d089bf tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:30.118208 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3c5fe09e-2f79-4181-9788-2b8402d089bf tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:30.256466 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3c5fe09e-2f79-4181-9788-2b8402d089bf tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:30.267655 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3c5fe09e-2f79-4181-9788-2b8402d089bf tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.168032 Jun 23 08:22:30.268427 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 173/346] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:30 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:30.899467 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5df0b6dc-f646-4825-86ca-d522251da0dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:30.900151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5df0b6dc-f646-4825-86ca-d522251da0dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:30.906959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5df0b6dc-f646-4825-86ca-d522251da0dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:30.907448 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5df0b6dc-f646-4825-86ca-d522251da0dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:30.908391 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5df0b6dc-f646-4825-86ca-d522251da0dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:30.908897 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5df0b6dc-f646-4825-86ca-d522251da0dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:30.921984 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-895e5147-a9a8-4767-bc1e-89568a15b80c req-254bac1e-1714-4926-9346-7473ecdfbe35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd6acd4-3db6-42bd-9ddf-d36044988fa8", "name": "network-vif-plugged", "status": "completed", "tag": "a47687d5-476a-4f0d-a81f-dc7638c31c20"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:30.930287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-895e5147-a9a8-4767-bc1e-89568a15b80c req-254bac1e-1714-4926-9346-7473ecdfbe35 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:30.930697 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-895e5147-a9a8-4767-bc1e-89568a15b80c req-254bac1e-1714-4926-9346-7473ecdfbe35 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:30.945123 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-895e5147-a9a8-4767-bc1e-89568a15b80c req-254bac1e-1714-4926-9346-7473ecdfbe35 service nova] Creating event network-vif-plugged:a47687d5-476a-4f0d-a81f-dc7638c31c20 for instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 on hv-cinder-84721 Jun 23 08:22:30.950358 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-895e5147-a9a8-4767-bc1e-89568a15b80c req-254bac1e-1714-4926-9346-7473ecdfbe35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Jun 23 08:22:30.951384 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 174/347] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:22:31.060731 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5df0b6dc-f646-4825-86ca-d522251da0dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:31.068826 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5df0b6dc-f646-4825-86ca-d522251da0dd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1501 microversion: 2.1 time: 0.173502 Jun 23 08:22:31.069575 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 174/348] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:30 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:31.088950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-be545085-30c4-49f4-bdc8-42943578f7d3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:31.089638 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-be545085-30c4-49f4-bdc8-42943578f7d3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:31.096355 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be545085-30c4-49f4-bdc8-42943578f7d3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:31.096793 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be545085-30c4-49f4-bdc8-42943578f7d3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:31.097816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be545085-30c4-49f4-bdc8-42943578f7d3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:31.098241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be545085-30c4-49f4-bdc8-42943578f7d3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:31.237378 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-be545085-30c4-49f4-bdc8-42943578f7d3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:31.246578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-be545085-30c4-49f4-bdc8-42943578f7d3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1515 microversion: 2.1 time: 0.161638 Jun 23 08:22:31.255170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 175/349] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:31 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:31.287377 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f852f2ba-1ca8-4507-a3d4-067a5711bc72 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:31.288505 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f852f2ba-1ca8-4507-a3d4-067a5711bc72 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:31.294960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f852f2ba-1ca8-4507-a3d4-067a5711bc72 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:31.295337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f852f2ba-1ca8-4507-a3d4-067a5711bc72 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:31.296093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f852f2ba-1ca8-4507-a3d4-067a5711bc72 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:31.296517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f852f2ba-1ca8-4507-a3d4-067a5711bc72 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:31.435360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f852f2ba-1ca8-4507-a3d4-067a5711bc72 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:31.443233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f852f2ba-1ca8-4507-a3d4-067a5711bc72 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.162843 Jun 23 08:22:31.443853 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 175/350] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:31 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:32.464712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d2bab1e3-1278-4456-8fc8-34a41f91ae48 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:32.465750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d2bab1e3-1278-4456-8fc8-34a41f91ae48 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:32.475145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2bab1e3-1278-4456-8fc8-34a41f91ae48 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:32.475643 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2bab1e3-1278-4456-8fc8-34a41f91ae48 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:32.476397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2bab1e3-1278-4456-8fc8-34a41f91ae48 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:32.476821 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2bab1e3-1278-4456-8fc8-34a41f91ae48 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:32.613916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d2bab1e3-1278-4456-8fc8-34a41f91ae48 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:32.621622 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d2bab1e3-1278-4456-8fc8-34a41f91ae48 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1313 microversion: 2.1 time: 0.163289 Jun 23 08:22:32.622186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 176/351] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:32 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:33.638222 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d9dff3ec-5cc1-4163-9acf-c04c0a6414db tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:33.638841 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d9dff3ec-5cc1-4163-9acf-c04c0a6414db tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:33.645457 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d9dff3ec-5cc1-4163-9acf-c04c0a6414db tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:33.645898 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d9dff3ec-5cc1-4163-9acf-c04c0a6414db tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:33.646685 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d9dff3ec-5cc1-4163-9acf-c04c0a6414db tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:33.647117 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d9dff3ec-5cc1-4163-9acf-c04c0a6414db tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:33.668793 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7232cee3-8a7b-4446-816b-d0ec45bd4d8d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:33.669749 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7232cee3-8a7b-4446-816b-d0ec45bd4d8d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:33.676417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7232cee3-8a7b-4446-816b-d0ec45bd4d8d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:33.676880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7232cee3-8a7b-4446-816b-d0ec45bd4d8d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:33.677628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7232cee3-8a7b-4446-816b-d0ec45bd4d8d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:33.678047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7232cee3-8a7b-4446-816b-d0ec45bd4d8d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:33.701743 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-7232cee3-8a7b-4446-816b-d0ec45bd4d8d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lazy-loading 'flavor' on Instance uuid 2adbdb87-cc07-4747-9533-ed6cc8926aee {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:22:33.786339 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d9dff3ec-5cc1-4163-9acf-c04c0a6414db tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:33.795533 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d9dff3ec-5cc1-4163-9acf-c04c0a6414db tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1497 microversion: 2.1 time: 0.161180 Jun 23 08:22:33.796435 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 176/352] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:33 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:33.816280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:33.830979 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7232cee3-8a7b-4446-816b-d0ec45bd4d8d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee/action" status: 200 len: 32 microversion: 2.1 time: 0.166219 Jun 23 08:22:33.831960 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 177/353] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:22:33 2022] POST /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:22:33.844304 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4af85f1d-fe0e-4d29-b329-c863a7529647 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:33.845168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4af85f1d-fe0e-4d29-b329-c863a7529647 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:33.853316 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4af85f1d-fe0e-4d29-b329-c863a7529647 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:33.853746 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4af85f1d-fe0e-4d29-b329-c863a7529647 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:33.854524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4af85f1d-fe0e-4d29-b329-c863a7529647 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:33.854948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4af85f1d-fe0e-4d29-b329-c863a7529647 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:34.081156 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4af85f1d-fe0e-4d29-b329-c863a7529647 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:34.089404 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4af85f1d-fe0e-4d29-b329-c863a7529647 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.251419 Jun 23 08:22:34.089985 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 177/354] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:33 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:34.877550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-39d31eab-7224-448c-b657-f920c63af83d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:34.878129 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-39d31eab-7224-448c-b657-f920c63af83d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:34.886630 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-39d31eab-7224-448c-b657-f920c63af83d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:34.887069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-39d31eab-7224-448c-b657-f920c63af83d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:34.887855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-39d31eab-7224-448c-b657-f920c63af83d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:34.888277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-39d31eab-7224-448c-b657-f920c63af83d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:34.914503 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-39d31eab-7224-448c-b657-f920c63af83d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:22:35.001092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-39d31eab-7224-448c-b657-f920c63af83d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 204 len: 0 microversion: 2.1 time: 0.128727 Jun 23 08:22:35.001670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 178/355] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:22:34 2022] DELETE /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:22:35.009927 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-26ec135e-7f05-4e84-bb3a-384cac4ccca6 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:35.010621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-26ec135e-7f05-4e84-bb3a-384cac4ccca6 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:35.017024 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26ec135e-7f05-4e84-bb3a-384cac4ccca6 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:35.017683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26ec135e-7f05-4e84-bb3a-384cac4ccca6 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:35.018478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26ec135e-7f05-4e84-bb3a-384cac4ccca6 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:35.018842 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26ec135e-7f05-4e84-bb3a-384cac4ccca6 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:35.107394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c0c0573e-9f30-44ab-b901-582c52e38996 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:35.108179 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c0c0573e-9f30-44ab-b901-582c52e38996 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:35.114603 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c0c0573e-9f30-44ab-b901-582c52e38996 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:35.115004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c0c0573e-9f30-44ab-b901-582c52e38996 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:35.115790 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c0c0573e-9f30-44ab-b901-582c52e38996 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:35.116252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c0c0573e-9f30-44ab-b901-582c52e38996 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:35.265158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c0c0573e-9f30-44ab-b901-582c52e38996 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:35.273619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c0c0573e-9f30-44ab-b901-582c52e38996 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.170304 Jun 23 08:22:35.274201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 179/356] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:35 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:35.381289 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-26ec135e-7f05-4e84-bb3a-384cac4ccca6 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:35.389288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-26ec135e-7f05-4e84-bb3a-384cac4ccca6 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1503 microversion: 2.1 time: 0.383082 Jun 23 08:22:35.389885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 178/357] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:35 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:22:36.292557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6dc3e423-3706-4ae7-ba24-d36c663a000b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:36.293206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6dc3e423-3706-4ae7-ba24-d36c663a000b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:36.299293 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dc3e423-3706-4ae7-ba24-d36c663a000b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:36.299788 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dc3e423-3706-4ae7-ba24-d36c663a000b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:36.300647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dc3e423-3706-4ae7-ba24-d36c663a000b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:36.301745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6dc3e423-3706-4ae7-ba24-d36c663a000b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:36.406005 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-03ff162e-1ab2-471d-9166-24a6ff954fdc tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:36.406564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-03ff162e-1ab2-471d-9166-24a6ff954fdc tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:36.413127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03ff162e-1ab2-471d-9166-24a6ff954fdc tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:36.413537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03ff162e-1ab2-471d-9166-24a6ff954fdc tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:36.414322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03ff162e-1ab2-471d-9166-24a6ff954fdc tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:36.414741 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03ff162e-1ab2-471d-9166-24a6ff954fdc tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:36.442080 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6dc3e423-3706-4ae7-ba24-d36c663a000b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:36.449817 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6dc3e423-3706-4ae7-ba24-d36c663a000b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.161742 Jun 23 08:22:36.450391 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 180/358] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:36 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:36.545604 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-03ff162e-1ab2-471d-9166-24a6ff954fdc tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:36.553734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-03ff162e-1ab2-471d-9166-24a6ff954fdc tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1503 microversion: 2.1 time: 0.151597 Jun 23 08:22:36.554454 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 179/359] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:36 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:37.472334 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8bb893fb-aeb1-41c7-9662-d10e92bb40ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:37.473341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8bb893fb-aeb1-41c7-9662-d10e92bb40ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:37.484701 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8bb893fb-aeb1-41c7-9662-d10e92bb40ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:37.485455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8bb893fb-aeb1-41c7-9662-d10e92bb40ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:37.486697 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8bb893fb-aeb1-41c7-9662-d10e92bb40ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:37.487440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8bb893fb-aeb1-41c7-9662-d10e92bb40ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:37.570965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-705d92c9-53b0-47fd-85e6-8953113b6c01 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:37.571959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-705d92c9-53b0-47fd-85e6-8953113b6c01 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:37.577959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-705d92c9-53b0-47fd-85e6-8953113b6c01 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:37.578508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-705d92c9-53b0-47fd-85e6-8953113b6c01 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:37.579345 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-705d92c9-53b0-47fd-85e6-8953113b6c01 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:37.579779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-705d92c9-53b0-47fd-85e6-8953113b6c01 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:37.640160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8bb893fb-aeb1-41c7-9662-d10e92bb40ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:37.650574 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8bb893fb-aeb1-41c7-9662-d10e92bb40ed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.182868 Jun 23 08:22:37.650574 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 181/360] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:37 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:37.778836 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-705d92c9-53b0-47fd-85e6-8953113b6c01 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:37.786789 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-705d92c9-53b0-47fd-85e6-8953113b6c01 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 200 len: 1503 microversion: 2.1 time: 0.220273 Jun 23 08:22:37.787378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 180/361] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:37 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:38.177680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-206a5dc5-5777-474a-bef7-224d47e551e0 req-06a53631-e575-47d7-9476-9ae6a6a558d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd6acd4-3db6-42bd-9ddf-d36044988fa8", "name": "network-vif-deleted", "tag": "a47687d5-476a-4f0d-a81f-dc7638c31c20"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:38.187329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-206a5dc5-5777-474a-bef7-224d47e551e0 req-06a53631-e575-47d7-9476-9ae6a6a558d9 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:38.187329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-206a5dc5-5777-474a-bef7-224d47e551e0 req-06a53631-e575-47d7-9476-9ae6a6a558d9 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:38.199594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-206a5dc5-5777-474a-bef7-224d47e551e0 req-06a53631-e575-47d7-9476-9ae6a6a558d9 service nova] Creating event network-vif-deleted:a47687d5-476a-4f0d-a81f-dc7638c31c20 for instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 on hv-cinder-84721 Jun 23 08:22:38.204287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-206a5dc5-5777-474a-bef7-224d47e551e0 req-06a53631-e575-47d7-9476-9ae6a6a558d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031112 Jun 23 08:22:38.204937 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 182/362] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:22:38.667711 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c118959a-e359-4a29-af5d-66c11a1c4d03 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:38.668318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c118959a-e359-4a29-af5d-66c11a1c4d03 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:38.670195 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:38.675782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c118959a-e359-4a29-af5d-66c11a1c4d03 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:38.675782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c118959a-e359-4a29-af5d-66c11a1c4d03 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:38.676886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c118959a-e359-4a29-af5d-66c11a1c4d03 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:38.677287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c118959a-e359-4a29-af5d-66c11a1c4d03 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:38.818727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:38.820092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 8fd6acd4-3db6-42bd-9ddf-d36044988fa8] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:38.830290 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:38.830730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:38.831527 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:38.831962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:38.835924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c118959a-e359-4a29-af5d-66c11a1c4d03 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:38.846846 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] HTTP exception thrown: Instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 could not be found. Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Request method failure captured: Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 HTTP/1.1 Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCKzcGpmTnBfn-7QuiTR8fN1wTRy0xcy4Bt4a4jNnAHxP6YB6N5pVNk15M8SsoA39sU5Bj65nb01aq9iyAGKp7cQUTXZAtE4x-6bmJZIxS28faNKQb8b0tp1vyyAQJUnUbpMfC_D6JIF1P0zJu4UinTKQ0w8m8rKzl548Qkc53YAI3A Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: ad9e87cb4bc84ff294c69c2e54704c33 Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesActionsTest-146437673 Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:22:38.848648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad9e87cb4bc84ff294c69c2e54704c33", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad9e87cb4bc84ff294c69c2e54704c33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad9e87cb4bc84ff294c69c2e54704c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad9e87cb4bc84ff294c69c2e54704c33"}]}] Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesActionsTest-146437673 Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: ad9e87cb4bc84ff294c69c2e54704c33 Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesActionsTest-146437673 Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesActionsTest-146437673-project Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 2821263e860a449eb4472ed2c4203e20 Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesActionsTest-146437673-project Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 could not be found. Jun 23 08:22:38.850240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '8fd6acd4-3db6-42bd-9ddf-d36044988fa8'} Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 could not be found. Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:22:38.851315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 could not be found. Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 could not be found. Jun 23 08:22:38.852763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:22:38.854026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Returning 404 to user: Instance 8fd6acd4-3db6-42bd-9ddf-d36044988fa8 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:22:38.854121 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c118959a-e359-4a29-af5d-66c11a1c4d03 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.186773 Jun 23 08:22:38.854225 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b98bd28c-3f9e-41cb-aab0-75cf08b82b3d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8" status: 404 len: 111 microversion: 2.1 time: 0.050071 Jun 23 08:22:38.854225 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 183/363] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:38 2022] GET /compute/v2.1/servers/8fd6acd4-3db6-42bd-9ddf-d36044988fa8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:22:38.859611 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 181/364] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:38 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:38.964492 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-183907579", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "networks": [{"uuid": "b2d7a7e3-fb45-488f-8154-a48a9bf069c7"}]}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:39.019727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.network.neutron [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] validate_networks() for [('b2d7a7e3-fb45-488f-8154-a48a9bf069c7', None, None, None, None, None)] {{(pid=117758) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:22:39.379987 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Flavor limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:22:39.380470 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Image limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:22:39.380936 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Flavor pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:22:39.381287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Image pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:22:39.381706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:22:39.391324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:39.391765 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:39.392557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:39.392986 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:39.410726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Getting quotas for project ad9e87cb4bc84ff294c69c2e54704c33. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:22:39.415569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Getting quotas for user 2821263e860a449eb4472ed2c4203e20 and project ad9e87cb4bc84ff294c69c2e54704c33. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:22:39.427262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Going to run 1 instances... {{(pid=117758) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:22:39.429535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:22:39.476950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1a624c8c-ed00-48ef-9fb1-60c2e5ef56c2 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516291 Jun 23 08:22:39.477576 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 184/365] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:22:39.487891 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-46a5efa7-3e46-47ae-b9be-35ce6188392a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:39.488517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-46a5efa7-3e46-47ae-b9be-35ce6188392a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:39.547968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-46a5efa7-3e46-47ae-b9be-35ce6188392a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:39.554819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-46a5efa7-3e46-47ae-b9be-35ce6188392a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1213 microversion: 2.1 time: 0.071258 Jun 23 08:22:39.555448 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 182/366] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:39 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:22:39.866602 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8397e2eb-17d2-471d-8332-e40058bc4846 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:39.867509 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8397e2eb-17d2-471d-8332-e40058bc4846 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:39.874959 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8397e2eb-17d2-471d-8332-e40058bc4846 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:39.875435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8397e2eb-17d2-471d-8332-e40058bc4846 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:39.876210 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8397e2eb-17d2-471d-8332-e40058bc4846 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:39.876670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8397e2eb-17d2-471d-8332-e40058bc4846 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:40.015543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8397e2eb-17d2-471d-8332-e40058bc4846 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:40.023684 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8397e2eb-17d2-471d-8332-e40058bc4846 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.161666 Jun 23 08:22:40.024252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 185/367] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:39 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:40.572996 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5aec713d-35e6-4599-94b6-4fbff1414dc8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:40.573677 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5aec713d-35e6-4599-94b6-4fbff1414dc8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:40.581283 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5aec713d-35e6-4599-94b6-4fbff1414dc8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:40.582162 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5aec713d-35e6-4599-94b6-4fbff1414dc8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:40.583562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5aec713d-35e6-4599-94b6-4fbff1414dc8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:40.583989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5aec713d-35e6-4599-94b6-4fbff1414dc8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:40.662680 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5aec713d-35e6-4599-94b6-4fbff1414dc8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:40.670911 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5aec713d-35e6-4599-94b6-4fbff1414dc8 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1283 microversion: 2.1 time: 0.102621 Jun 23 08:22:40.671698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 183/368] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:40 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:41.041033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c9715e9a-69df-4721-86ae-f10f87409400 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:41.041594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c9715e9a-69df-4721-86ae-f10f87409400 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:41.048779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c9715e9a-69df-4721-86ae-f10f87409400 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:41.049222 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c9715e9a-69df-4721-86ae-f10f87409400 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:41.049996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c9715e9a-69df-4721-86ae-f10f87409400 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:41.050421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c9715e9a-69df-4721-86ae-f10f87409400 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:41.190879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c9715e9a-69df-4721-86ae-f10f87409400 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:41.198612 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c9715e9a-69df-4721-86ae-f10f87409400 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.161536 Jun 23 08:22:41.207312 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 186/369] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:41 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:41.688843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-14ec9720-fe3c-4252-b037-21a3e173008f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:41.689417 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-14ec9720-fe3c-4252-b037-21a3e173008f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:41.696177 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-14ec9720-fe3c-4252-b037-21a3e173008f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:41.696698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-14ec9720-fe3c-4252-b037-21a3e173008f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:41.697547 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-14ec9720-fe3c-4252-b037-21a3e173008f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:41.698048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-14ec9720-fe3c-4252-b037-21a3e173008f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:41.780004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-0c2fc219-b54c-48ff-8e77-495bc71b5fbb req-cb41067f-7743-4f4f-b7be-d31da2af0a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4726b758-0151-4352-a7ea-7ca099d01bf0", "tag": "fbb713df-59d4-44ac-97c8-3c13301b1401"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:41.788953 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-0c2fc219-b54c-48ff-8e77-495bc71b5fbb req-cb41067f-7743-4f4f-b7be-d31da2af0a99 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:41.789401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-0c2fc219-b54c-48ff-8e77-495bc71b5fbb req-cb41067f-7743-4f4f-b7be-d31da2af0a99 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:41.803389 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-0c2fc219-b54c-48ff-8e77-495bc71b5fbb req-cb41067f-7743-4f4f-b7be-d31da2af0a99 service nova] Creating event network-changed:fbb713df-59d4-44ac-97c8-3c13301b1401 for instance 4726b758-0151-4352-a7ea-7ca099d01bf0 on hv-cinder-84721 Jun 23 08:22:41.808629 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-0c2fc219-b54c-48ff-8e77-495bc71b5fbb req-cb41067f-7743-4f4f-b7be-d31da2af0a99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032326 Jun 23 08:22:41.809247 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 187/370] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:22:41.923522 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-14ec9720-fe3c-4252-b037-21a3e173008f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:41.932068 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-14ec9720-fe3c-4252-b037-21a3e173008f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.247169 Jun 23 08:22:41.932654 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 184/371] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:41 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:42.220147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-fb99d00a-b07a-4c73-85dc-d286a7a4ba88 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:42.220906 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-fb99d00a-b07a-4c73-85dc-d286a7a4ba88 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:42.228516 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb99d00a-b07a-4c73-85dc-d286a7a4ba88 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:42.228954 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb99d00a-b07a-4c73-85dc-d286a7a4ba88 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:42.229769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb99d00a-b07a-4c73-85dc-d286a7a4ba88 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:42.230195 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb99d00a-b07a-4c73-85dc-d286a7a4ba88 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:42.366290 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-fb99d00a-b07a-4c73-85dc-d286a7a4ba88 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:42.374343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-fb99d00a-b07a-4c73-85dc-d286a7a4ba88 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.161392 Jun 23 08:22:42.374908 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 188/372] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:42 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:42.953678 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-95b5b814-2358-4713-81a9-7366dd90015e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:42.954576 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-95b5b814-2358-4713-81a9-7366dd90015e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:42.964934 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95b5b814-2358-4713-81a9-7366dd90015e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:42.965658 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95b5b814-2358-4713-81a9-7366dd90015e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:42.966889 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95b5b814-2358-4713-81a9-7366dd90015e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:42.967656 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95b5b814-2358-4713-81a9-7366dd90015e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:43.103839 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-95b5b814-2358-4713-81a9-7366dd90015e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:43.111194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-95b5b814-2358-4713-81a9-7366dd90015e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.164402 Jun 23 08:22:43.111784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 185/373] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:42 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:43.391522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b2d95322-2e0d-47c9-80e3-828984563dd5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:43.392104 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b2d95322-2e0d-47c9-80e3-828984563dd5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:43.398929 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2d95322-2e0d-47c9-80e3-828984563dd5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:43.399420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2d95322-2e0d-47c9-80e3-828984563dd5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:43.400180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2d95322-2e0d-47c9-80e3-828984563dd5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:43.400608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2d95322-2e0d-47c9-80e3-828984563dd5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:43.537089 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b2d95322-2e0d-47c9-80e3-828984563dd5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:43.544800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b2d95322-2e0d-47c9-80e3-828984563dd5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.157131 Jun 23 08:22:43.545374 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 189/374] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:43 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:44.128397 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-918c3927-3c8a-4eeb-9cb4-34ae54d03c2e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:44.129450 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-918c3927-3c8a-4eeb-9cb4-34ae54d03c2e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:44.135661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-918c3927-3c8a-4eeb-9cb4-34ae54d03c2e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:44.136100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-918c3927-3c8a-4eeb-9cb4-34ae54d03c2e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:44.136850 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-918c3927-3c8a-4eeb-9cb4-34ae54d03c2e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:44.137254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-918c3927-3c8a-4eeb-9cb4-34ae54d03c2e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:44.269628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-918c3927-3c8a-4eeb-9cb4-34ae54d03c2e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:44.277578 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-918c3927-3c8a-4eeb-9cb4-34ae54d03c2e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.153136 Jun 23 08:22:44.278134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 186/375] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:44 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:44.564322 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1054e730-bab9-4258-aad8-94dd2296b65b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:44.564922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1054e730-bab9-4258-aad8-94dd2296b65b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:44.571962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1054e730-bab9-4258-aad8-94dd2296b65b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:44.572402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1054e730-bab9-4258-aad8-94dd2296b65b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:44.573173 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1054e730-bab9-4258-aad8-94dd2296b65b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:44.573599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1054e730-bab9-4258-aad8-94dd2296b65b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:44.715432 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1054e730-bab9-4258-aad8-94dd2296b65b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:44.724093 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1054e730-bab9-4258-aad8-94dd2296b65b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.163568 Jun 23 08:22:44.724666 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 190/376] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:44 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:45.300356 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-95c76d01-a95e-4d75-8655-502a0868b75d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:45.302223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-95c76d01-a95e-4d75-8655-502a0868b75d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:45.312018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95c76d01-a95e-4d75-8655-502a0868b75d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:45.312760 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95c76d01-a95e-4d75-8655-502a0868b75d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:45.314025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95c76d01-a95e-4d75-8655-502a0868b75d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:45.314739 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95c76d01-a95e-4d75-8655-502a0868b75d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:45.457204 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-95c76d01-a95e-4d75-8655-502a0868b75d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:45.465193 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-95c76d01-a95e-4d75-8655-502a0868b75d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.172653 Jun 23 08:22:45.465787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 187/377] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:45 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:45.742336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-085b4e3f-8a83-4e6e-b97b-b85f1c728599 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:45.742968 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-085b4e3f-8a83-4e6e-b97b-b85f1c728599 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:45.750230 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-085b4e3f-8a83-4e6e-b97b-b85f1c728599 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:45.750671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-085b4e3f-8a83-4e6e-b97b-b85f1c728599 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:45.751488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-085b4e3f-8a83-4e6e-b97b-b85f1c728599 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:45.751921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-085b4e3f-8a83-4e6e-b97b-b85f1c728599 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:45.881663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-085b4e3f-8a83-4e6e-b97b-b85f1c728599 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:45.890227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-085b4e3f-8a83-4e6e-b97b-b85f1c728599 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.152002 Jun 23 08:22:45.890826 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 191/378] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:45 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:46.486779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c3fd8f1f-12f8-4568-a127-6361fce5844a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:46.487798 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c3fd8f1f-12f8-4568-a127-6361fce5844a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:46.494999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3fd8f1f-12f8-4568-a127-6361fce5844a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:46.495492 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3fd8f1f-12f8-4568-a127-6361fce5844a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:46.496261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3fd8f1f-12f8-4568-a127-6361fce5844a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:46.496695 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3fd8f1f-12f8-4568-a127-6361fce5844a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:46.634646 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c3fd8f1f-12f8-4568-a127-6361fce5844a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:46.642243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c3fd8f1f-12f8-4568-a127-6361fce5844a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.161914 Jun 23 08:22:46.642806 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 188/379] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:46 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:46.911461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cc0b704f-812c-445c-a643-e6b55bf70ab1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:46.912233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cc0b704f-812c-445c-a643-e6b55bf70ab1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:46.919815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cc0b704f-812c-445c-a643-e6b55bf70ab1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:46.920330 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cc0b704f-812c-445c-a643-e6b55bf70ab1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:46.921337 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cc0b704f-812c-445c-a643-e6b55bf70ab1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:46.921940 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cc0b704f-812c-445c-a643-e6b55bf70ab1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:47.061746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cc0b704f-812c-445c-a643-e6b55bf70ab1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:47.071329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cc0b704f-812c-445c-a643-e6b55bf70ab1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.166103 Jun 23 08:22:47.071927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 192/380] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:46 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:47.659694 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7689849e-7827-474b-b771-a5846757929c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:47.660320 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7689849e-7827-474b-b771-a5846757929c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:47.666747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7689849e-7827-474b-b771-a5846757929c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:47.667189 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7689849e-7827-474b-b771-a5846757929c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:47.667992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7689849e-7827-474b-b771-a5846757929c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:47.668416 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7689849e-7827-474b-b771-a5846757929c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:47.672798 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:47.827237 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7689849e-7827-474b-b771-a5846757929c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:47.836049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7689849e-7827-474b-b771-a5846757929c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.180552 Jun 23 08:22:47.836585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 189/381] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:47 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:48.093367 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e12c941a-0022-4edb-9c39-a075cdf7aff9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:48.094255 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e12c941a-0022-4edb-9c39-a075cdf7aff9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:48.098048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:48.107417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e12c941a-0022-4edb-9c39-a075cdf7aff9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:48.108172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e12c941a-0022-4edb-9c39-a075cdf7aff9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:48.109501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e12c941a-0022-4edb-9c39-a075cdf7aff9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:48.110226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e12c941a-0022-4edb-9c39-a075cdf7aff9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:48.251257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e12c941a-0022-4edb-9c39-a075cdf7aff9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:48.260332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e12c941a-0022-4edb-9c39-a075cdf7aff9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.173619 Jun 23 08:22:48.260905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 193/382] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:48 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:48.854073 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f11b90e2-2d47-42fd-9564-63d88c62b5de tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:48.855133 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f11b90e2-2d47-42fd-9564-63d88c62b5de tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:48.861171 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f11b90e2-2d47-42fd-9564-63d88c62b5de tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:48.861687 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f11b90e2-2d47-42fd-9564-63d88c62b5de tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:48.862532 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f11b90e2-2d47-42fd-9564-63d88c62b5de tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:48.863025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f11b90e2-2d47-42fd-9564-63d88c62b5de tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:49.005904 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f11b90e2-2d47-42fd-9564-63d88c62b5de tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:49.013513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f11b90e2-2d47-42fd-9564-63d88c62b5de tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.163471 Jun 23 08:22:49.014116 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 190/383] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:48 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:49.278133 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b94376be-f43f-4c55-80f0-2fe65d09cb51 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:49.278706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b94376be-f43f-4c55-80f0-2fe65d09cb51 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:49.285682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b94376be-f43f-4c55-80f0-2fe65d09cb51 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:49.286126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b94376be-f43f-4c55-80f0-2fe65d09cb51 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:49.287116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b94376be-f43f-4c55-80f0-2fe65d09cb51 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:49.287361 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b94376be-f43f-4c55-80f0-2fe65d09cb51 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:49.399135 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:49.418697 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b94376be-f43f-4c55-80f0-2fe65d09cb51 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:49.422161 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=6 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:49.427601 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b94376be-f43f-4c55-80f0-2fe65d09cb51 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.153363 Jun 23 08:22:49.428179 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 194/384] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:49 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:50.034807 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e9d2c94b-882a-417d-9081-b2c6e1138f8a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:50.035769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e9d2c94b-882a-417d-9081-b2c6e1138f8a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:50.038688 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:50.047975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9d2c94b-882a-417d-9081-b2c6e1138f8a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:50.048692 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9d2c94b-882a-417d-9081-b2c6e1138f8a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:50.049964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9d2c94b-882a-417d-9081-b2c6e1138f8a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:50.050661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9d2c94b-882a-417d-9081-b2c6e1138f8a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:50.181859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e9d2c94b-882a-417d-9081-b2c6e1138f8a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:50.195006 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e9d2c94b-882a-417d-9081-b2c6e1138f8a tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.166399 Jun 23 08:22:50.195830 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 191/385] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:50 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:50.453066 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d8b28052-e092-49a3-b917-624637f80fd8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:50.453601 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d8b28052-e092-49a3-b917-624637f80fd8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:50.460901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8b28052-e092-49a3-b917-624637f80fd8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:50.461348 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8b28052-e092-49a3-b917-624637f80fd8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:50.462109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8b28052-e092-49a3-b917-624637f80fd8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:50.462538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8b28052-e092-49a3-b917-624637f80fd8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:50.480950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:22:50.792050 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d8b28052-e092-49a3-b917-624637f80fd8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:50.800429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d8b28052-e092-49a3-b917-624637f80fd8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.351157 Jun 23 08:22:50.801267 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 195/386] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:50 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:51.212300 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-12f22711-7e46-4b5c-b627-c879ff15af97 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:51.212945 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-12f22711-7e46-4b5c-b627-c879ff15af97 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:51.220108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12f22711-7e46-4b5c-b627-c879ff15af97 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:51.220782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12f22711-7e46-4b5c-b627-c879ff15af97 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:51.221751 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12f22711-7e46-4b5c-b627-c879ff15af97 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:51.222371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12f22711-7e46-4b5c-b627-c879ff15af97 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:51.340283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-7527ecd7-2565-4f0a-af8f-3f1f34961c47 req-c76a83ec-0586-4143-bf7b-a01161a3e189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4726b758-0151-4352-a7ea-7ca099d01bf0", "name": "network-vif-plugged", "status": "completed", "tag": "fbb713df-59d4-44ac-97c8-3c13301b1401"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:51.349145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-7527ecd7-2565-4f0a-af8f-3f1f34961c47 req-c76a83ec-0586-4143-bf7b-a01161a3e189 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:51.349727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-7527ecd7-2565-4f0a-af8f-3f1f34961c47 req-c76a83ec-0586-4143-bf7b-a01161a3e189 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:51.363153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-7527ecd7-2565-4f0a-af8f-3f1f34961c47 req-c76a83ec-0586-4143-bf7b-a01161a3e189 service nova] Creating event network-vif-plugged:fbb713df-59d4-44ac-97c8-3c13301b1401 for instance 4726b758-0151-4352-a7ea-7ca099d01bf0 on hv-cinder-84721 Jun 23 08:22:51.368555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-7527ecd7-2565-4f0a-af8f-3f1f34961c47 req-c76a83ec-0586-4143-bf7b-a01161a3e189 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032543 Jun 23 08:22:51.372841 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-12f22711-7e46-4b5c-b627-c879ff15af97 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:51.376678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 196/387] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:22:51.380858 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-12f22711-7e46-4b5c-b627-c879ff15af97 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.172523 Jun 23 08:22:51.381558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 192/388] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:51 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:51.820158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-825a593a-20d6-4602-a1a7-efc2a4aec353 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:51.820856 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-825a593a-20d6-4602-a1a7-efc2a4aec353 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:51.828146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-825a593a-20d6-4602-a1a7-efc2a4aec353 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:51.828602 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-825a593a-20d6-4602-a1a7-efc2a4aec353 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:51.829364 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-825a593a-20d6-4602-a1a7-efc2a4aec353 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:51.829799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-825a593a-20d6-4602-a1a7-efc2a4aec353 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:51.960794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-825a593a-20d6-4602-a1a7-efc2a4aec353 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:51.968697 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-825a593a-20d6-4602-a1a7-efc2a4aec353 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.153241 Jun 23 08:22:51.969237 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 197/389] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:51 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:52.398118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2024140f-b9d0-4bc4-a542-ab4ce1917178 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:52.398847 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2024140f-b9d0-4bc4-a542-ab4ce1917178 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:52.405387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2024140f-b9d0-4bc4-a542-ab4ce1917178 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:52.405829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2024140f-b9d0-4bc4-a542-ab4ce1917178 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:52.406583 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2024140f-b9d0-4bc4-a542-ab4ce1917178 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:52.407008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2024140f-b9d0-4bc4-a542-ab4ce1917178 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:52.537522 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2024140f-b9d0-4bc4-a542-ab4ce1917178 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:52.545234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2024140f-b9d0-4bc4-a542-ab4ce1917178 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.151002 Jun 23 08:22:52.545798 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 193/390] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:52 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:52.990097 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0aa2154f-55e4-4527-9f0d-8c45a49fd368 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:52.991146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0aa2154f-55e4-4527-9f0d-8c45a49fd368 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:53.002549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0aa2154f-55e4-4527-9f0d-8c45a49fd368 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:53.003288 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0aa2154f-55e4-4527-9f0d-8c45a49fd368 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:53.004585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0aa2154f-55e4-4527-9f0d-8c45a49fd368 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:53.005388 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0aa2154f-55e4-4527-9f0d-8c45a49fd368 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:53.152336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0aa2154f-55e4-4527-9f0d-8c45a49fd368 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:53.161492 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0aa2154f-55e4-4527-9f0d-8c45a49fd368 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.178103 Jun 23 08:22:53.162049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 198/391] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:52 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:53.562909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3292aa17-b457-4d84-ba4b-928d7694c91f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:53.563542 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3292aa17-b457-4d84-ba4b-928d7694c91f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:53.570355 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3292aa17-b457-4d84-ba4b-928d7694c91f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:53.570800 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3292aa17-b457-4d84-ba4b-928d7694c91f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:53.571590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3292aa17-b457-4d84-ba4b-928d7694c91f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:53.572020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3292aa17-b457-4d84-ba4b-928d7694c91f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:53.709422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3292aa17-b457-4d84-ba4b-928d7694c91f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:53.717254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3292aa17-b457-4d84-ba4b-928d7694c91f tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1313 microversion: 2.1 time: 0.158221 Jun 23 08:22:53.717800 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 194/392] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:53 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:54.183274 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-852a90a5-2ee9-43d0-84d2-d0b5209b7c72 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:54.184268 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-852a90a5-2ee9-43d0-84d2-d0b5209b7c72 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:54.194522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-852a90a5-2ee9-43d0-84d2-d0b5209b7c72 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:54.194868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-852a90a5-2ee9-43d0-84d2-d0b5209b7c72 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:54.195680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-852a90a5-2ee9-43d0-84d2-d0b5209b7c72 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:54.196111 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-852a90a5-2ee9-43d0-84d2-d0b5209b7c72 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:54.227977 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2ffb3b5a-2c8e-42ae-a905-76cd0bd6b8d6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d64d3d28-911c-44c0-bf06-c609d1a31b4a", "device": "/dev/sdb"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:22:54.229667 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2ffb3b5a-2c8e-42ae-a905-76cd0bd6b8d6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:54.236041 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2ffb3b5a-2c8e-42ae-a905-76cd0bd6b8d6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:54.236724 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2ffb3b5a-2c8e-42ae-a905-76cd0bd6b8d6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:54.237513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2ffb3b5a-2c8e-42ae-a905-76cd0bd6b8d6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:54.237947 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2ffb3b5a-2c8e-42ae-a905-76cd0bd6b8d6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:54.340876 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-852a90a5-2ee9-43d0-84d2-d0b5209b7c72 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:54.348543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-852a90a5-2ee9-43d0-84d2-d0b5209b7c72 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.171567 Jun 23 08:22:54.349809 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 199/393] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:54 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:54.738042 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2ac6e554-4f2f-4fbf-9de4-308ace1ac688 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:54.738973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2ac6e554-4f2f-4fbf-9de4-308ace1ac688 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:54.745995 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ac6e554-4f2f-4fbf-9de4-308ace1ac688 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:54.746441 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ac6e554-4f2f-4fbf-9de4-308ace1ac688 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:54.747568 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ac6e554-4f2f-4fbf-9de4-308ace1ac688 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:54.748008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ac6e554-4f2f-4fbf-9de4-308ace1ac688 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:54.883758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2ac6e554-4f2f-4fbf-9de4-308ace1ac688 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:54.894547 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2ac6e554-4f2f-4fbf-9de4-308ace1ac688 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1497 microversion: 2.1 time: 0.163155 Jun 23 08:22:54.895530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 200/394] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:54 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:55.368178 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-64f58262-855a-4ff7-bccd-7a3005143bd0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:55.368834 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-64f58262-855a-4ff7-bccd-7a3005143bd0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:55.376208 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-64f58262-855a-4ff7-bccd-7a3005143bd0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:55.376647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-64f58262-855a-4ff7-bccd-7a3005143bd0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:55.377427 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-64f58262-855a-4ff7-bccd-7a3005143bd0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:55.377824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-64f58262-855a-4ff7-bccd-7a3005143bd0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:55.533358 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-64f58262-855a-4ff7-bccd-7a3005143bd0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:55.542184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-64f58262-855a-4ff7-bccd-7a3005143bd0 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.177994 Jun 23 08:22:55.551537 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 201/395] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:55 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:55.580381 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-43518d21-c92f-42de-8fc9-40589215185c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:55.580875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-43518d21-c92f-42de-8fc9-40589215185c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:55.588677 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-43518d21-c92f-42de-8fc9-40589215185c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:55.589118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-43518d21-c92f-42de-8fc9-40589215185c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:55.589877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-43518d21-c92f-42de-8fc9-40589215185c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:55.590303 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-43518d21-c92f-42de-8fc9-40589215185c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:55.615553 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-43518d21-c92f-42de-8fc9-40589215185c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:22:55.700090 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-43518d21-c92f-42de-8fc9-40589215185c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 204 len: 0 microversion: 2.1 time: 0.122818 Jun 23 08:22:55.700818 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 202/396] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:22:55 2022] DELETE /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:22:55.713156 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-79f462b0-48ef-4651-a77e-54a643ba5f4c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:55.714160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-79f462b0-48ef-4651-a77e-54a643ba5f4c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:55.722450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-79f462b0-48ef-4651-a77e-54a643ba5f4c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:55.723011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-79f462b0-48ef-4651-a77e-54a643ba5f4c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:55.724174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-79f462b0-48ef-4651-a77e-54a643ba5f4c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:55.724790 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-79f462b0-48ef-4651-a77e-54a643ba5f4c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:55.866556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-79f462b0-48ef-4651-a77e-54a643ba5f4c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:55.875138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-79f462b0-48ef-4651-a77e-54a643ba5f4c tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1503 microversion: 2.1 time: 0.168663 Jun 23 08:22:55.875750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 203/397] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:55 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:22:56.559799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b354efd7-57cb-46e3-accc-455cd3555b35 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:56.560462 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b354efd7-57cb-46e3-accc-455cd3555b35 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:56.569095 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b354efd7-57cb-46e3-accc-455cd3555b35 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:56.569994 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b354efd7-57cb-46e3-accc-455cd3555b35 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:56.570299 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b354efd7-57cb-46e3-accc-455cd3555b35 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:56.570722 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b354efd7-57cb-46e3-accc-455cd3555b35 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:56.728314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b354efd7-57cb-46e3-accc-455cd3555b35 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:56.736243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b354efd7-57cb-46e3-accc-455cd3555b35 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.180317 Jun 23 08:22:56.736844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 204/398] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:56 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:56.811456 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2ffb3b5a-2c8e-42ae-a905-76cd0bd6b8d6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "POST /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.587196 Jun 23 08:22:56.812065 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 195/399] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:22:54 2022] POST /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6/os-volume_attachments => generated 194 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:22:56.895636 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bd0d51a0-db59-4483-88c5-3f56549fbb62 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:56.896479 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bd0d51a0-db59-4483-88c5-3f56549fbb62 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:56.903038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd0d51a0-db59-4483-88c5-3f56549fbb62 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:56.903517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd0d51a0-db59-4483-88c5-3f56549fbb62 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:56.904273 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd0d51a0-db59-4483-88c5-3f56549fbb62 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:56.904697 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd0d51a0-db59-4483-88c5-3f56549fbb62 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:57.036169 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bd0d51a0-db59-4483-88c5-3f56549fbb62 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:57.047599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bd0d51a0-db59-4483-88c5-3f56549fbb62 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1503 microversion: 2.1 time: 0.157678 Jun 23 08:22:57.048375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 205/400] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:56 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:57.756448 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6c625760-7639-45d5-8125-a0a31730efa9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:57.758390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6c625760-7639-45d5-8125-a0a31730efa9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:57.766111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6c625760-7639-45d5-8125-a0a31730efa9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:57.766560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6c625760-7639-45d5-8125-a0a31730efa9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:57.767593 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6c625760-7639-45d5-8125-a0a31730efa9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:57.768029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6c625760-7639-45d5-8125-a0a31730efa9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:57.949883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6c625760-7639-45d5-8125-a0a31730efa9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:57.963862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6c625760-7639-45d5-8125-a0a31730efa9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.214020 Jun 23 08:22:57.964455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 196/401] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:57 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:58.069889 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8fc53997-f3e4-453a-bc5a-adcc26d56f94 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:58.070518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8fc53997-f3e4-453a-bc5a-adcc26d56f94 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:58.078458 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8fc53997-f3e4-453a-bc5a-adcc26d56f94 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:58.078917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8fc53997-f3e4-453a-bc5a-adcc26d56f94 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:58.079771 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8fc53997-f3e4-453a-bc5a-adcc26d56f94 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:58.080278 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8fc53997-f3e4-453a-bc5a-adcc26d56f94 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:58.247826 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8fc53997-f3e4-453a-bc5a-adcc26d56f94 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:58.259827 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8fc53997-f3e4-453a-bc5a-adcc26d56f94 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1503 microversion: 2.1 time: 0.196769 Jun 23 08:22:58.260608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 206/402] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:58 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:58.988758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9e6fadef-4ec5-4f10-85a0-50f4130058f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:58.989900 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9e6fadef-4ec5-4f10-85a0-50f4130058f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:58.997721 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9e6fadef-4ec5-4f10-85a0-50f4130058f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:58.998136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9e6fadef-4ec5-4f10-85a0-50f4130058f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:58.999398 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9e6fadef-4ec5-4f10-85a0-50f4130058f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:58.999777 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9e6fadef-4ec5-4f10-85a0-50f4130058f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:59.151231 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9e6fadef-4ec5-4f10-85a0-50f4130058f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:59.159449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9e6fadef-4ec5-4f10-85a0-50f4130058f7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.175919 Jun 23 08:22:59.160013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 197/403] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:58 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:22:59.279040 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0135dc7f-c500-4f01-b6e1-f6c1f1ea3b49 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:22:59.279772 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0135dc7f-c500-4f01-b6e1-f6c1f1ea3b49 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:22:59.288440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0135dc7f-c500-4f01-b6e1-f6c1f1ea3b49 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:59.289080 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0135dc7f-c500-4f01-b6e1-f6c1f1ea3b49 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:59.290313 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0135dc7f-c500-4f01-b6e1-f6c1f1ea3b49 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:22:59.291103 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0135dc7f-c500-4f01-b6e1-f6c1f1ea3b49 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:22:59.431990 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0135dc7f-c500-4f01-b6e1-f6c1f1ea3b49 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:22:59.439683 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0135dc7f-c500-4f01-b6e1-f6c1f1ea3b49 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1503 microversion: 2.1 time: 0.166242 Jun 23 08:22:59.440250 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 207/404] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:22:59 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:00.182460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6de56b16-3a6c-4d4f-9770-5118b78dc4aa tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:00.183085 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6de56b16-3a6c-4d4f-9770-5118b78dc4aa tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:00.190811 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6de56b16-3a6c-4d4f-9770-5118b78dc4aa tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:00.191953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6de56b16-3a6c-4d4f-9770-5118b78dc4aa tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:00.192374 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6de56b16-3a6c-4d4f-9770-5118b78dc4aa tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:00.192818 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6de56b16-3a6c-4d4f-9770-5118b78dc4aa tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:00.231905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-846f364d-c700-4965-af79-24957938a065 req-0806b032-03e5-4203-b582-02f96833b61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4726b758-0151-4352-a7ea-7ca099d01bf0", "name": "network-vif-deleted", "tag": "fbb713df-59d4-44ac-97c8-3c13301b1401"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:00.240413 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-846f364d-c700-4965-af79-24957938a065 req-0806b032-03e5-4203-b582-02f96833b61b service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:00.241086 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-846f364d-c700-4965-af79-24957938a065 req-0806b032-03e5-4203-b582-02f96833b61b service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:00.252757 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-846f364d-c700-4965-af79-24957938a065 req-0806b032-03e5-4203-b582-02f96833b61b service nova] Creating event network-vif-deleted:fbb713df-59d4-44ac-97c8-3c13301b1401 for instance 4726b758-0151-4352-a7ea-7ca099d01bf0 on hv-cinder-84721 Jun 23 08:23:00.258172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-846f364d-c700-4965-af79-24957938a065 req-0806b032-03e5-4203-b582-02f96833b61b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030137 Jun 23 08:23:00.258852 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 208/405] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:23:00.342843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6de56b16-3a6c-4d4f-9770-5118b78dc4aa tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:00.353119 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6de56b16-3a6c-4d4f-9770-5118b78dc4aa tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.179685 Jun 23 08:23:00.353708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 198/406] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:00 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:00.458350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-be52cd2f-7a2f-4d49-8454-4ad4eab3f388 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:00.458967 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-be52cd2f-7a2f-4d49-8454-4ad4eab3f388 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:00.465882 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be52cd2f-7a2f-4d49-8454-4ad4eab3f388 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:00.466332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be52cd2f-7a2f-4d49-8454-4ad4eab3f388 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:00.467102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be52cd2f-7a2f-4d49-8454-4ad4eab3f388 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:00.467570 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be52cd2f-7a2f-4d49-8454-4ad4eab3f388 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:00.532664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-be52cd2f-7a2f-4d49-8454-4ad4eab3f388 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:00.540992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-be52cd2f-7a2f-4d49-8454-4ad4eab3f388 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1461 microversion: 2.1 time: 0.087693 Jun 23 08:23:00.541571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 209/407] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:00 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:01.375004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b501571e-fbd1-4d38-b4c5-a14b5cc5bb5f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:01.376012 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b501571e-fbd1-4d38-b4c5-a14b5cc5bb5f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:01.387108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b501571e-fbd1-4d38-b4c5-a14b5cc5bb5f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:01.387881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b501571e-fbd1-4d38-b4c5-a14b5cc5bb5f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:01.389118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b501571e-fbd1-4d38-b4c5-a14b5cc5bb5f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:01.389820 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b501571e-fbd1-4d38-b4c5-a14b5cc5bb5f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:01.531395 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b501571e-fbd1-4d38-b4c5-a14b5cc5bb5f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:01.539808 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b501571e-fbd1-4d38-b4c5-a14b5cc5bb5f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.171566 Jun 23 08:23:01.540657 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 199/408] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:01 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:01.558104 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b4947601-82f9-4439-a7ac-3937326896d4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:01.558694 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b4947601-82f9-4439-a7ac-3937326896d4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:01.565890 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b4947601-82f9-4439-a7ac-3937326896d4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:01.566382 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b4947601-82f9-4439-a7ac-3937326896d4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:01.567376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b4947601-82f9-4439-a7ac-3937326896d4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:01.567801 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b4947601-82f9-4439-a7ac-3937326896d4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:01.634387 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b4947601-82f9-4439-a7ac-3937326896d4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:01.642874 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b4947601-82f9-4439-a7ac-3937326896d4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1461 microversion: 2.1 time: 0.088607 Jun 23 08:23:01.643471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 210/409] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:01 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1461 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:02.559854 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a49023a8-19c4-4fc5-bd21-a228cf9aad59 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:02.560484 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a49023a8-19c4-4fc5-bd21-a228cf9aad59 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:02.570414 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a49023a8-19c4-4fc5-bd21-a228cf9aad59 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:02.570850 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a49023a8-19c4-4fc5-bd21-a228cf9aad59 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:02.571633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a49023a8-19c4-4fc5-bd21-a228cf9aad59 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:02.572055 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a49023a8-19c4-4fc5-bd21-a228cf9aad59 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:02.665308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a983e817-6a74-4a79-9a45-82cf860442e4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:02.666549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a983e817-6a74-4a79-9a45-82cf860442e4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:02.672937 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a983e817-6a74-4a79-9a45-82cf860442e4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:02.673437 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a983e817-6a74-4a79-9a45-82cf860442e4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:02.674269 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a983e817-6a74-4a79-9a45-82cf860442e4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:02.674696 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a983e817-6a74-4a79-9a45-82cf860442e4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:02.707125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a49023a8-19c4-4fc5-bd21-a228cf9aad59 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:02.715080 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a49023a8-19c4-4fc5-bd21-a228cf9aad59 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.160883 Jun 23 08:23:02.715691 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 200/410] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:02 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:02.736931 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a983e817-6a74-4a79-9a45-82cf860442e4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:02.740610 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:02.745205 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a983e817-6a74-4a79-9a45-82cf860442e4 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1461 microversion: 2.1 time: 0.083924 Jun 23 08:23:02.745766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 211/411] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:02 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:23:03.735889 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f46b4056-f3b1-4ef0-a07a-179aea2461eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:03.736873 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f46b4056-f3b1-4ef0-a07a-179aea2461eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:03.745745 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f46b4056-f3b1-4ef0-a07a-179aea2461eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:03.746156 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f46b4056-f3b1-4ef0-a07a-179aea2461eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:03.746903 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f46b4056-f3b1-4ef0-a07a-179aea2461eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:03.747664 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f46b4056-f3b1-4ef0-a07a-179aea2461eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:03.762402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3f6129b5-fd51-43f3-9a3b-43f17320f372 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:03.763762 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3f6129b5-fd51-43f3-9a3b-43f17320f372 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:03.771546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3f6129b5-fd51-43f3-9a3b-43f17320f372 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:03.771981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3f6129b5-fd51-43f3-9a3b-43f17320f372 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:03.772769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3f6129b5-fd51-43f3-9a3b-43f17320f372 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:03.773263 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3f6129b5-fd51-43f3-9a3b-43f17320f372 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:03.852677 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3f6129b5-fd51-43f3-9a3b-43f17320f372 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:03.860911 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3f6129b5-fd51-43f3-9a3b-43f17320f372 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1461 microversion: 2.1 time: 0.102798 Jun 23 08:23:03.861788 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 212/412] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:03 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1461 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:03.895273 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f46b4056-f3b1-4ef0-a07a-179aea2461eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:03.902932 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f46b4056-f3b1-4ef0-a07a-179aea2461eb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.173573 Jun 23 08:23:03.903497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 201/413] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:03 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:04.879239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:04.879973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:04.886732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:04.887188 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:04.887956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:04.888386 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:04.920603 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:04.920821 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ceac23d2-ca58-4016-89d9-487d54b12c21 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:04.921325 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:04.921421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ceac23d2-ca58-4016-89d9-487d54b12c21 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:04.921512 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lazy-loading 'fault' on Instance uuid 4726b758-0151-4352-a7ea-7ca099d01bf0 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:23:04.928031 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ceac23d2-ca58-4016-89d9-487d54b12c21 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:04.928470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ceac23d2-ca58-4016-89d9-487d54b12c21 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:04.929201 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ceac23d2-ca58-4016-89d9-487d54b12c21 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:04.929688 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ceac23d2-ca58-4016-89d9-487d54b12c21 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:04.962982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:04.971004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c5dd7c0e-4f77-4bf4-bf47-5700ba45d78d tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1303 microversion: 2.1 time: 0.095630 Jun 23 08:23:04.971580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 213/414] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:04 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:05.063384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ceac23d2-ca58-4016-89d9-487d54b12c21 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:05.071687 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ceac23d2-ca58-4016-89d9-487d54b12c21 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1501 microversion: 2.1 time: 0.154838 Jun 23 08:23:05.072272 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 202/415] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:04 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:23:05.088611 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8f8df42-38f8-4ca8-ba16-3ccf57c93209"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:05.089793 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:05.096089 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:05.096527 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:05.097258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:05.097686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:05.121129 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] HTTP exception thrown: Cannot 'attach_volume' instance 2adbdb87-cc07-4747-9533-ed6cc8926aee while it is in vm_state rescued Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Request method failure captured: Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: POST /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee/os-volume_attachments HTTP/1.1 Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 74 Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJChJuRl63ByKI4uH1OC4o9svwQYL4HltjBZBwnz5-qllbB3CpWe6Xp9jZmIprSCRruFVHJNwKDgIPOzE2-kP1fGVUBk1FT01qYJ9qbOA4y73qaa4LRrpY7TsfrjCCFhb-Xvl4ha7hGPtLKGh6Il5Kg3gY-w4aXUS_Af-aoIHBNNTI Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:23:05.123365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d08f2f4ac6d54f7484711b28f48aeeb3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}] Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: a15a0abc2f25410b8476464d7cd32802 Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {"volumeAttachment": {"volumeId": "a8f8df42-38f8-4ca8-ba16-3ccf57c93209"}} Jun 23 08:23:05.124923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Cannot 'attach_volume' instance 2adbdb87-cc07-4747-9533-ed6cc8926aee while it is in vm_state rescued Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'server_id': '2adbdb87-cc07-4747-9533-ed6cc8926aee', 'body': {'volumeAttachment': {'volumeId': 'a8f8df42-38f8-4ca8-ba16-3ccf57c93209'}}} Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2adbdb87-cc07-4747-9533-ed6cc8926aee in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:23:05.125700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2adbdb87-cc07-4747-9533-ed6cc8926aee while it is in vm_state rescued Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:23:05.126778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:23:05.127901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:23:05.127901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:23:05.127901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2adbdb87-cc07-4747-9533-ed6cc8926aee while it is in vm_state rescued Jun 23 08:23:05.127901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:23:05.127901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Returning 409 to user: Cannot 'attach_volume' instance 2adbdb87-cc07-4747-9533-ed6cc8926aee while it is in vm_state rescued {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:23:05.127901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ec330867-7baa-4ccc-937e-1c561aabdaed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040667 Jun 23 08:23:05.127901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 214/416] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:23:05 2022] POST /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 23 08:23:05.135324 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2ace63da-ba17-43ee-9bf1-15e18148c56d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:05.136155 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2ace63da-ba17-43ee-9bf1-15e18148c56d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:05.142409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2ace63da-ba17-43ee-9bf1-15e18148c56d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:05.142964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2ace63da-ba17-43ee-9bf1-15e18148c56d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:05.143856 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2ace63da-ba17-43ee-9bf1-15e18148c56d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:05.144473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2ace63da-ba17-43ee-9bf1-15e18148c56d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:05.193895 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:05.221436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2ace63da-ba17-43ee-9bf1-15e18148c56d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee/action" status: 202 len: 0 microversion: 2.1 time: 0.090448 Jun 23 08:23:05.222089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 203/417] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:23:05 2022] POST /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:23:05.230970 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6f55ae7b-1a1d-462b-bdf3-7449da087d34 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:05.231645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6f55ae7b-1a1d-462b-bdf3-7449da087d34 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:05.237853 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f55ae7b-1a1d-462b-bdf3-7449da087d34 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:05.238307 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f55ae7b-1a1d-462b-bdf3-7449da087d34 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:05.239078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f55ae7b-1a1d-462b-bdf3-7449da087d34 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:05.239545 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f55ae7b-1a1d-462b-bdf3-7449da087d34 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:05.381614 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6f55ae7b-1a1d-462b-bdf3-7449da087d34 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:05.392380 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6f55ae7b-1a1d-462b-bdf3-7449da087d34 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.165877 Jun 23 08:23:05.399188 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 215/418] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:05 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:05.993182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:05.993889 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:06.003486 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:06.004031 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:06.004965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:06.005536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:06.042776 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:06.043201 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:06.043665 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lazy-loading 'fault' on Instance uuid 4726b758-0151-4352-a7ea-7ca099d01bf0 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:23:06.088316 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:06.096220 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-22ab72d6-b6bb-405e-aff5-15e19294dd91 tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1303 microversion: 2.1 time: 0.110243 Jun 23 08:23:06.096774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 204/419] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:05 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:06.416257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9ef244b9-1c96-4488-8d1f-d0614ca8e468 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:06.416784 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9ef244b9-1c96-4488-8d1f-d0614ca8e468 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:06.423644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9ef244b9-1c96-4488-8d1f-d0614ca8e468 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:06.424205 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9ef244b9-1c96-4488-8d1f-d0614ca8e468 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:06.425215 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9ef244b9-1c96-4488-8d1f-d0614ca8e468 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:06.425916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9ef244b9-1c96-4488-8d1f-d0614ca8e468 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:06.558909 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9ef244b9-1c96-4488-8d1f-d0614ca8e468 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:06.570179 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9ef244b9-1c96-4488-8d1f-d0614ca8e468 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.159753 Jun 23 08:23:06.571454 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 216/420] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:06 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:07.118705 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:07.119786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:07.131016 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:07.131799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:07.132969 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:07.133376 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:07.164617 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:07.165051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:07.165485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lazy-loading 'fault' on Instance uuid 4726b758-0151-4352-a7ea-7ca099d01bf0 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:23:07.211102 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:07.218988 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-048503f4-1302-44eb-bbf1-3dcbce5d81fd tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1303 microversion: 2.1 time: 0.106678 Jun 23 08:23:07.219570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 205/421] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:07 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:07.591641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6f35ed73-493f-43fe-bc85-9d52cf62bfc2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:07.592583 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6f35ed73-493f-43fe-bc85-9d52cf62bfc2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:07.602881 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f35ed73-493f-43fe-bc85-9d52cf62bfc2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:07.603375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f35ed73-493f-43fe-bc85-9d52cf62bfc2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:07.604157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f35ed73-493f-43fe-bc85-9d52cf62bfc2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:07.604587 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f35ed73-493f-43fe-bc85-9d52cf62bfc2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:07.740441 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6f35ed73-493f-43fe-bc85-9d52cf62bfc2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:07.751839 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6f35ed73-493f-43fe-bc85-9d52cf62bfc2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.166577 Jun 23 08:23:07.752532 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 217/422] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:07 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:08.240202 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:08.241179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:08.248717 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:08.249152 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:08.249902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:08.250330 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:08.281715 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:08.282147 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:08.282611 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lazy-loading 'fault' on Instance uuid 4726b758-0151-4352-a7ea-7ca099d01bf0 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:23:08.324475 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:08.332225 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dc250f14-0e2f-4787-ab31-a4f7a7309f6e tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1303 microversion: 2.1 time: 0.098494 Jun 23 08:23:08.332778 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 206/423] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:08 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:08.773536 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e935824b-9d8c-473f-a64d-3b64a5e56450 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:08.774122 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e935824b-9d8c-473f-a64d-3b64a5e56450 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:08.781355 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e935824b-9d8c-473f-a64d-3b64a5e56450 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:08.781823 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e935824b-9d8c-473f-a64d-3b64a5e56450 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:08.782621 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e935824b-9d8c-473f-a64d-3b64a5e56450 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:08.783070 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e935824b-9d8c-473f-a64d-3b64a5e56450 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:08.925713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e935824b-9d8c-473f-a64d-3b64a5e56450 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:08.933787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e935824b-9d8c-473f-a64d-3b64a5e56450 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.166877 Jun 23 08:23:08.934352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 218/424] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:08 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:09.348596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:09.349219 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:09.351762 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=60 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:09.357262 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:09.357705 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:09.358464 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:09.358892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:09.391479 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:09.391924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:09.392395 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lazy-loading 'fault' on Instance uuid 4726b758-0151-4352-a7ea-7ca099d01bf0 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:23:09.433970 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2821263e860a449eb4472ed2c4203e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9e87cb4bc84ff294c69c2e54704c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:09.441657 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-689582fb-40e1-4b11-af40-5e60da519b7b tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 200 len: 1303 microversion: 2.1 time: 0.096948 Jun 23 08:23:09.442213 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 207/425] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:09 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:09.957808 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8300dc77-e892-42d7-8ba1-699d8f06580f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:09.959278 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8300dc77-e892-42d7-8ba1-699d8f06580f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:09.966560 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8300dc77-e892-42d7-8ba1-699d8f06580f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:09.967166 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8300dc77-e892-42d7-8ba1-699d8f06580f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:09.968219 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8300dc77-e892-42d7-8ba1-699d8f06580f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:09.968861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8300dc77-e892-42d7-8ba1-699d8f06580f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:10.113042 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8300dc77-e892-42d7-8ba1-699d8f06580f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:10.120731 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8300dc77-e892-42d7-8ba1-699d8f06580f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.167352 Jun 23 08:23:10.121233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 219/426] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:09 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:10.459904 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:10.460592 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] [instance: 4726b758-0151-4352-a7ea-7ca099d01bf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:10.467442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:10.467877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:10.468677 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:10.469103 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:10.482893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] HTTP exception thrown: Instance 4726b758-0151-4352-a7ea-7ca099d01bf0 could not be found. Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Request method failure captured: Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 HTTP/1.1 Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCKzcGpmTnBfn-7QuiTR8fN1wTRy0xcy4Bt4a4jNnAHxP6YB6N5pVNk15M8SsoA39sU5Bj65nb01aq9iyAGKp7cQUTXZAtE4x-6bmJZIxS28faNKQb8b0tp1vyyAQJUnUbpMfC_D6JIF1P0zJu4UinTKQ0w8m8rKzl548Qkc53YAI3A Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: ad9e87cb4bc84ff294c69c2e54704c33 Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-VolumesActionsTest-146437673 Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:23:10.488357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad9e87cb4bc84ff294c69c2e54704c33", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad9e87cb4bc84ff294c69c2e54704c33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad9e87cb4bc84ff294c69c2e54704c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad9e87cb4bc84ff294c69c2e54704c33"}]}] Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-VolumesActionsTest-146437673 Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: ad9e87cb4bc84ff294c69c2e54704c33 Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-VolumesActionsTest-146437673 Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-VolumesActionsTest-146437673-project Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 2821263e860a449eb4472ed2c4203e20 Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-VolumesActionsTest-146437673-project Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 4726b758-0151-4352-a7ea-7ca099d01bf0 could not be found. Jun 23 08:23:10.489719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '4726b758-0151-4352-a7ea-7ca099d01bf0'} Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4726b758-0151-4352-a7ea-7ca099d01bf0 could not be found. Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:23:10.490452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4726b758-0151-4352-a7ea-7ca099d01bf0 could not be found. Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4726b758-0151-4352-a7ea-7ca099d01bf0 could not be found. Jun 23 08:23:10.492093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:23:10.493279 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] Returning 404 to user: Instance 4726b758-0151-4352-a7ea-7ca099d01bf0 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:23:10.493279 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-45a79c25-01f0-4cae-8aa0-7420011974ce tempest-VolumesActionsTest-146437673 tempest-VolumesActionsTest-146437673-project] 10.222.0.33 "GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0" status: 404 len: 111 microversion: 2.1 time: 0.030448 Jun 23 08:23:10.493279 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 208/427] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:10 2022] GET /compute/v2.1/servers/4726b758-0151-4352-a7ea-7ca099d01bf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:23:11.138144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7aeb0431-1a1f-432a-81e7-0e3b50c434c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:11.138774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7aeb0431-1a1f-432a-81e7-0e3b50c434c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:11.145508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7aeb0431-1a1f-432a-81e7-0e3b50c434c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:11.145946 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7aeb0431-1a1f-432a-81e7-0e3b50c434c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:11.146700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7aeb0431-1a1f-432a-81e7-0e3b50c434c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:11.147122 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7aeb0431-1a1f-432a-81e7-0e3b50c434c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:11.289871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7aeb0431-1a1f-432a-81e7-0e3b50c434c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:11.297994 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7aeb0431-1a1f-432a-81e7-0e3b50c434c3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.163890 Jun 23 08:23:11.298555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 220/428] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:11 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:12.319649 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a0e9408a-3abc-42c8-9000-42ec32b01209 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:12.320647 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a0e9408a-3abc-42c8-9000-42ec32b01209 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:12.330529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a0e9408a-3abc-42c8-9000-42ec32b01209 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:12.331175 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a0e9408a-3abc-42c8-9000-42ec32b01209 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:12.332337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a0e9408a-3abc-42c8-9000-42ec32b01209 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:12.332974 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a0e9408a-3abc-42c8-9000-42ec32b01209 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:12.474044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a0e9408a-3abc-42c8-9000-42ec32b01209 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:12.482950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a0e9408a-3abc-42c8-9000-42ec32b01209 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.170210 Jun 23 08:23:12.483619 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 209/429] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:12 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:13.500932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-688425b6-cab6-480d-85fb-b6bc49de42df tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:13.501535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-688425b6-cab6-480d-85fb-b6bc49de42df tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:13.509287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-688425b6-cab6-480d-85fb-b6bc49de42df tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:13.509744 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-688425b6-cab6-480d-85fb-b6bc49de42df tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:13.510670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-688425b6-cab6-480d-85fb-b6bc49de42df tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:13.510942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-688425b6-cab6-480d-85fb-b6bc49de42df tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:13.642168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-688425b6-cab6-480d-85fb-b6bc49de42df tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:13.650035 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-688425b6-cab6-480d-85fb-b6bc49de42df tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.153422 Jun 23 08:23:13.650577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 221/430] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:13 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:14.671509 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8c96f24f-7ff7-4c64-b4a0-35c1ecc6ea46 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:14.672505 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8c96f24f-7ff7-4c64-b4a0-35c1ecc6ea46 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:14.682053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8c96f24f-7ff7-4c64-b4a0-35c1ecc6ea46 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:14.682501 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8c96f24f-7ff7-4c64-b4a0-35c1ecc6ea46 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:14.683370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8c96f24f-7ff7-4c64-b4a0-35c1ecc6ea46 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:14.683794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8c96f24f-7ff7-4c64-b4a0-35c1ecc6ea46 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:14.820100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8c96f24f-7ff7-4c64-b4a0-35c1ecc6ea46 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:14.827817 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8c96f24f-7ff7-4c64-b4a0-35c1ecc6ea46 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.162846 Jun 23 08:23:14.828596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 210/431] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:14 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:15.850277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-35cfb8e6-0b18-49c6-b850-684a6ef8cf9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:15.851562 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-35cfb8e6-0b18-49c6-b850-684a6ef8cf9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:15.858970 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-35cfb8e6-0b18-49c6-b850-684a6ef8cf9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:15.859441 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-35cfb8e6-0b18-49c6-b850-684a6ef8cf9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:15.860197 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-35cfb8e6-0b18-49c6-b850-684a6ef8cf9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:15.860622 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-35cfb8e6-0b18-49c6-b850-684a6ef8cf9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:16.006365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-35cfb8e6-0b18-49c6-b850-684a6ef8cf9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:16.014443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-35cfb8e6-0b18-49c6-b850-684a6ef8cf9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.170998 Jun 23 08:23:16.015011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 222/432] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:15 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:17.031780 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2913626c-cbec-4a5b-912a-a79c7507ebff tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:17.032429 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2913626c-cbec-4a5b-912a-a79c7507ebff tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:17.039409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2913626c-cbec-4a5b-912a-a79c7507ebff tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:17.039854 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2913626c-cbec-4a5b-912a-a79c7507ebff tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:17.040599 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2913626c-cbec-4a5b-912a-a79c7507ebff tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:17.041063 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2913626c-cbec-4a5b-912a-a79c7507ebff tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:17.185059 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2913626c-cbec-4a5b-912a-a79c7507ebff tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:17.193042 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2913626c-cbec-4a5b-912a-a79c7507ebff tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.165118 Jun 23 08:23:17.193537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 211/433] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:17 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:18.209937 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-802a03d1-36c3-463f-8a2d-e9c74e04dcb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:18.210545 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-802a03d1-36c3-463f-8a2d-e9c74e04dcb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:18.212980 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:18.220342 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-802a03d1-36c3-463f-8a2d-e9c74e04dcb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:18.220898 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-802a03d1-36c3-463f-8a2d-e9c74e04dcb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:18.221837 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-802a03d1-36c3-463f-8a2d-e9c74e04dcb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:18.222272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-802a03d1-36c3-463f-8a2d-e9c74e04dcb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:18.367324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-802a03d1-36c3-463f-8a2d-e9c74e04dcb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:18.376698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-802a03d1-36c3-463f-8a2d-e9c74e04dcb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1509 microversion: 2.1 time: 0.170608 Jun 23 08:23:18.377271 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 223/434] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:18 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:19.399825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7a95cd46-2182-4884-9163-8d40f77a2f58 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:19.400424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7a95cd46-2182-4884-9163-8d40f77a2f58 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:19.407594 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a95cd46-2182-4884-9163-8d40f77a2f58 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:19.408034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a95cd46-2182-4884-9163-8d40f77a2f58 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:19.408785 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a95cd46-2182-4884-9163-8d40f77a2f58 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:19.409202 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a95cd46-2182-4884-9163-8d40f77a2f58 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:19.548306 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7a95cd46-2182-4884-9163-8d40f77a2f58 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:19.559626 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7a95cd46-2182-4884-9163-8d40f77a2f58 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1515 microversion: 2.1 time: 0.163389 Jun 23 08:23:19.560398 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 212/435] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:19 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:27.293137 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7dc23455-db05-44a9-8b54-a11dfd754502 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'create', calling method: .version_select at 0x7feb6812d1f0>, body: {"keypair": {"name": "tempest-keypair-359633739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3YO6qVhbTqtVSi9kUx5wej0QMtksESO1JqUnuNXMuKCpVEYgXB4SdcdTuTpA3AsALEJSwl05SEryFbBYRl6WhD08FH3bnWBLmkQhWJjeWGOWX0I3C77MzwMExcPkYmjg=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:27.307743 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-7dc23455-db05-44a9-8b54-a11dfd754502 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Getting quotas for project d08f2f4ac6d54f7484711b28f48aeeb3. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:23:27.312022 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-7dc23455-db05-44a9-8b54-a11dfd754502 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Getting quotas for user a15a0abc2f25410b8476464d7cd32802 and project d08f2f4ac6d54f7484711b28f48aeeb3. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:23:27.327106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7dc23455-db05-44a9-8b54-a11dfd754502 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [a2ead828-aa9b-4658-a284-047d14ef7fc4] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 08:23:28.338238 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [None req-7dc23455-db05-44a9-8b54-a11dfd754502 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [a2ead828-aa9b-4658-a284-047d14ef7fc4] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 47642. Jun 23 08:23:28.357841 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7dc23455-db05-44a9-8b54-a11dfd754502 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.069421 Jun 23 08:23:28.358769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 224/436] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:23:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:23:29.769491 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1623210810", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9eb3d75-18c6-4965-8c86-82c4fd973741"}], "security_groups": [{"name": "tempest-securitygroup--1029657375"}], "key_name": "tempest-keypair-359633739", "user_data": "}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:29.778935 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=13 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:29.779598 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:29.894329 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] validate_networks() for [('e9eb3d75-18c6-4965-8c86-82c4fd973741', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:23:30.525578 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:23:30.526268 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:23:30.526847 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:23:30.527243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:23:30.527686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:23:30.537504 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:30.537939 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:30.538712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:30.539131 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:30.564750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Getting quotas for project d08f2f4ac6d54f7484711b28f48aeeb3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:23:30.569167 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Getting quotas for user a15a0abc2f25410b8476464d7cd32802 and project d08f2f4ac6d54f7484711b28f48aeeb3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:23:30.582126 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:23:30.584440 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:23:30.634851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f2b4b850-bfbf-4d3a-91bd-c6e0ef0d982b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.873283 Jun 23 08:23:30.635658 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 213/437] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:23:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:23:30.647009 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=72 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:30.662053 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-37807b8b-953e-4847-9f1a-9a10ea8b4bed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:30.662943 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-37807b8b-953e-4847-9f1a-9a10ea8b4bed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:30.726024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-37807b8b-953e-4847-9f1a-9a10ea8b4bed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:30.735035 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-37807b8b-953e-4847-9f1a-9a10ea8b4bed tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1245 microversion: 2.1 time: 0.088378 Jun 23 08:23:30.735690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 225/438] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:30 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:31.753014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7dc01cd9-d292-4140-a21c-1e8467637991 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:31.754492 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7dc01cd9-d292-4140-a21c-1e8467637991 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:31.760773 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7dc01cd9-d292-4140-a21c-1e8467637991 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:31.761319 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7dc01cd9-d292-4140-a21c-1e8467637991 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:31.761981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7dc01cd9-d292-4140-a21c-1e8467637991 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:31.762965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7dc01cd9-d292-4140-a21c-1e8467637991 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:31.845639 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7dc01cd9-d292-4140-a21c-1e8467637991 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:31.854129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7dc01cd9-d292-4140-a21c-1e8467637991 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1305 microversion: 2.1 time: 0.105462 Jun 23 08:23:31.854954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 214/439] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:31 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:32.872773 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f89eb67b-19bc-4e09-8231-9563e0639f3c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:32.873399 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f89eb67b-19bc-4e09-8231-9563e0639f3c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:32.882151 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f89eb67b-19bc-4e09-8231-9563e0639f3c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:32.882817 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f89eb67b-19bc-4e09-8231-9563e0639f3c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:32.884936 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f89eb67b-19bc-4e09-8231-9563e0639f3c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:32.885423 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f89eb67b-19bc-4e09-8231-9563e0639f3c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:33.049786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f89eb67b-19bc-4e09-8231-9563e0639f3c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:33.060062 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f89eb67b-19bc-4e09-8231-9563e0639f3c tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.191422 Jun 23 08:23:33.061281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 226/440] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:32 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:33.353442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-1542e8e8-463f-440f-a821-eb41d80c3b42 req-23d9119a-77b7-4295-96a1-5ca62481ddae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca4749e-9663-407f-a8fd-e58e91f7d55e", "tag": "cd2d7e86-3a51-4611-8caf-4bdf9ed2b077"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:33.367655 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-1542e8e8-463f-440f-a821-eb41d80c3b42 req-23d9119a-77b7-4295-96a1-5ca62481ddae service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:33.368321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-1542e8e8-463f-440f-a821-eb41d80c3b42 req-23d9119a-77b7-4295-96a1-5ca62481ddae service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:33.380496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-1542e8e8-463f-440f-a821-eb41d80c3b42 req-23d9119a-77b7-4295-96a1-5ca62481ddae service nova] Creating event network-changed:cd2d7e86-3a51-4611-8caf-4bdf9ed2b077 for instance fca4749e-9663-407f-a8fd-e58e91f7d55e on hv-cinder-84721 Jun 23 08:23:33.386164 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-1542e8e8-463f-440f-a821-eb41d80c3b42 req-23d9119a-77b7-4295-96a1-5ca62481ddae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036427 Jun 23 08:23:33.386542 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 215/441] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:23:34.078086 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-38660549-50f9-43fb-9b07-5bc6eaee0ee8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:34.078678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-38660549-50f9-43fb-9b07-5bc6eaee0ee8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:34.085754 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-38660549-50f9-43fb-9b07-5bc6eaee0ee8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:34.086198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-38660549-50f9-43fb-9b07-5bc6eaee0ee8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:34.086958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-38660549-50f9-43fb-9b07-5bc6eaee0ee8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:34.087436 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-38660549-50f9-43fb-9b07-5bc6eaee0ee8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:34.229155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-38660549-50f9-43fb-9b07-5bc6eaee0ee8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:34.238694 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-38660549-50f9-43fb-9b07-5bc6eaee0ee8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.164334 Jun 23 08:23:34.249808 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 227/442] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:34 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:35.256846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-710e7857-9c04-4a8a-a1ce-203529eafa4d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:35.257481 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-710e7857-9c04-4a8a-a1ce-203529eafa4d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:35.264493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-710e7857-9c04-4a8a-a1ce-203529eafa4d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:35.264940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-710e7857-9c04-4a8a-a1ce-203529eafa4d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:35.265703 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-710e7857-9c04-4a8a-a1ce-203529eafa4d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:35.266132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-710e7857-9c04-4a8a-a1ce-203529eafa4d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:35.408846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-710e7857-9c04-4a8a-a1ce-203529eafa4d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:35.416792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-710e7857-9c04-4a8a-a1ce-203529eafa4d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.164719 Jun 23 08:23:35.417359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 216/443] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:35 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:36.436207 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-93225226-68c6-4f11-a3d2-a885e384ea5d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:36.436858 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-93225226-68c6-4f11-a3d2-a885e384ea5d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:36.444895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-93225226-68c6-4f11-a3d2-a885e384ea5d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:36.445371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-93225226-68c6-4f11-a3d2-a885e384ea5d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:36.446213 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-93225226-68c6-4f11-a3d2-a885e384ea5d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:36.446675 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-93225226-68c6-4f11-a3d2-a885e384ea5d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:36.592340 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-93225226-68c6-4f11-a3d2-a885e384ea5d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:36.599979 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-93225226-68c6-4f11-a3d2-a885e384ea5d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.169546 Jun 23 08:23:36.600539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 228/444] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:36 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:37.625456 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3bf9ffd8-7da6-458a-a2f4-aa439f7fc18b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:37.626303 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3bf9ffd8-7da6-458a-a2f4-aa439f7fc18b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:37.635743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3bf9ffd8-7da6-458a-a2f4-aa439f7fc18b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:37.636183 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3bf9ffd8-7da6-458a-a2f4-aa439f7fc18b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:37.636961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3bf9ffd8-7da6-458a-a2f4-aa439f7fc18b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:37.637368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3bf9ffd8-7da6-458a-a2f4-aa439f7fc18b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:37.768859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:23:37.769083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Thu Jun 23 08:23:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e (ip 10.222.0.33) !!! Jun 23 08:23:37.840802 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3bf9ffd8-7da6-458a-a2f4-aa439f7fc18b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:37.848566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3bf9ffd8-7da6-458a-a2f4-aa439f7fc18b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.229029 Jun 23 08:23:37.849313 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 217/445] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:37 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:38.870109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ff78265e-9848-4b43-b40f-eb05b0e4c291 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:38.870857 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ff78265e-9848-4b43-b40f-eb05b0e4c291 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:38.879070 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff78265e-9848-4b43-b40f-eb05b0e4c291 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:38.879610 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff78265e-9848-4b43-b40f-eb05b0e4c291 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:38.880514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff78265e-9848-4b43-b40f-eb05b0e4c291 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:38.881014 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff78265e-9848-4b43-b40f-eb05b0e4c291 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:39.023902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ff78265e-9848-4b43-b40f-eb05b0e4c291 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:39.032006 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ff78265e-9848-4b43-b40f-eb05b0e4c291 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.166410 Jun 23 08:23:39.043077 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 229/446] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:38 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:40.050503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4a1a5a1a-6b56-4065-a246-eb62ebd6ef97 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:40.051131 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4a1a5a1a-6b56-4065-a246-eb62ebd6ef97 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:40.058674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a1a5a1a-6b56-4065-a246-eb62ebd6ef97 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:40.059139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a1a5a1a-6b56-4065-a246-eb62ebd6ef97 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:40.059975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a1a5a1a-6b56-4065-a246-eb62ebd6ef97 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:40.060425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a1a5a1a-6b56-4065-a246-eb62ebd6ef97 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:40.203073 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4a1a5a1a-6b56-4065-a246-eb62ebd6ef97 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:40.211178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4a1a5a1a-6b56-4065-a246-eb62ebd6ef97 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.164806 Jun 23 08:23:40.211789 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 218/447] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:40 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:41.228865 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1a9bf4cd-b7fc-4e91-a54e-4bb52e05a101 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:41.230205 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1a9bf4cd-b7fc-4e91-a54e-4bb52e05a101 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:41.232761 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=6 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:41.238634 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a9bf4cd-b7fc-4e91-a54e-4bb52e05a101 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:41.239108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a9bf4cd-b7fc-4e91-a54e-4bb52e05a101 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:41.239903 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a9bf4cd-b7fc-4e91-a54e-4bb52e05a101 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:41.240335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a9bf4cd-b7fc-4e91-a54e-4bb52e05a101 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:41.442921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1a9bf4cd-b7fc-4e91-a54e-4bb52e05a101 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:41.458033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1a9bf4cd-b7fc-4e91-a54e-4bb52e05a101 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.232821 Jun 23 08:23:41.458877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 230/448] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:41 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:41.731538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c1ca8782-2851-4050-a59a-b2d36da00598 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:41.732766 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c1ca8782-2851-4050-a59a-b2d36da00598 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:41.735824 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:41.737198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:41.743296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c1ca8782-2851-4050-a59a-b2d36da00598 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:41.743812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c1ca8782-2851-4050-a59a-b2d36da00598 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:41.744889 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c1ca8782-2851-4050-a59a-b2d36da00598 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:41.745580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c1ca8782-2851-4050-a59a-b2d36da00598 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:41.778162 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c1ca8782-2851-4050-a59a-b2d36da00598 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/ips" status: 200 len: 150 microversion: 2.1 time: 0.050903 Jun 23 08:23:41.779030 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 219/449] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:23:41 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:23:42.474655 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2553dc87-c8a7-45b0-8071-2e16cc4b8e40 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:42.475298 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2553dc87-c8a7-45b0-8071-2e16cc4b8e40 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:42.482904 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2553dc87-c8a7-45b0-8071-2e16cc4b8e40 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:42.483379 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2553dc87-c8a7-45b0-8071-2e16cc4b8e40 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:42.484149 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2553dc87-c8a7-45b0-8071-2e16cc4b8e40 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:42.484582 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2553dc87-c8a7-45b0-8071-2e16cc4b8e40 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:42.623366 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2553dc87-c8a7-45b0-8071-2e16cc4b8e40 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:42.632404 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2553dc87-c8a7-45b0-8071-2e16cc4b8e40 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.161589 Jun 23 08:23:42.632945 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 231/450] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:42 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:43.648854 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3d9e6776-2a70-4a4c-8a6c-b3cde337410d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:43.649454 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3d9e6776-2a70-4a4c-8a6c-b3cde337410d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:43.656592 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3d9e6776-2a70-4a4c-8a6c-b3cde337410d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:43.657030 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3d9e6776-2a70-4a4c-8a6c-b3cde337410d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:43.657788 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3d9e6776-2a70-4a4c-8a6c-b3cde337410d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:43.658210 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3d9e6776-2a70-4a4c-8a6c-b3cde337410d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:43.818674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3d9e6776-2a70-4a4c-8a6c-b3cde337410d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:43.833201 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3d9e6776-2a70-4a4c-8a6c-b3cde337410d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.188049 Jun 23 08:23:43.834067 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 220/451] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:43 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:44.850224 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-844c226b-c182-4773-a35a-6d22a0adf3c4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:44.850799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-844c226b-c182-4773-a35a-6d22a0adf3c4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:44.857867 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-844c226b-c182-4773-a35a-6d22a0adf3c4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:44.858303 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-844c226b-c182-4773-a35a-6d22a0adf3c4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:44.859057 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-844c226b-c182-4773-a35a-6d22a0adf3c4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:44.859520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-844c226b-c182-4773-a35a-6d22a0adf3c4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:45.015256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-844c226b-c182-4773-a35a-6d22a0adf3c4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:45.023190 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-844c226b-c182-4773-a35a-6d22a0adf3c4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.176959 Jun 23 08:23:45.023783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 232/452] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:44 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:46.053663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f5f97ab2-8341-44ac-84d3-52f2c1c6a3db tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:46.054258 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f5f97ab2-8341-44ac-84d3-52f2c1c6a3db tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:46.062055 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f5f97ab2-8341-44ac-84d3-52f2c1c6a3db tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:46.063524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f5f97ab2-8341-44ac-84d3-52f2c1c6a3db tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:46.064287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f5f97ab2-8341-44ac-84d3-52f2c1c6a3db tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:46.064980 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f5f97ab2-8341-44ac-84d3-52f2c1c6a3db tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:46.237674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f5f97ab2-8341-44ac-84d3-52f2c1c6a3db tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:46.275007 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f5f97ab2-8341-44ac-84d3-52f2c1c6a3db tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.238233 Jun 23 08:23:46.276278 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 221/453] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:46 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:46.422172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-336c97ab-4397-4a15-93ac-57b942b114db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5a99389-f8f3-4285-9543-f9ac3650ea93"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:46.423686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-336c97ab-4397-4a15-93ac-57b942b114db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:46.435238 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-336c97ab-4397-4a15-93ac-57b942b114db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:46.436488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-336c97ab-4397-4a15-93ac-57b942b114db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:46.438051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-336c97ab-4397-4a15-93ac-57b942b114db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:46.438638 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-336c97ab-4397-4a15-93ac-57b942b114db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:46.897089 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-336c97ab-4397-4a15-93ac-57b942b114db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480088 Jun 23 08:23:46.898013 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 233/454] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:23:46 2022] POST /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments => generated 194 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:23:47.299856 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a468b165-45db-420d-99f4-32d7c575c964 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:47.303151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a468b165-45db-420d-99f4-32d7c575c964 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:47.320052 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a468b165-45db-420d-99f4-32d7c575c964 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:47.321700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a468b165-45db-420d-99f4-32d7c575c964 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:47.324085 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a468b165-45db-420d-99f4-32d7c575c964 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:47.325218 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a468b165-45db-420d-99f4-32d7c575c964 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:47.598425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a468b165-45db-420d-99f4-32d7c575c964 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:47.615699 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a468b165-45db-420d-99f4-32d7c575c964 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.325178 Jun 23 08:23:47.618185 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 222/455] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:47 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:47.837124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-20ac084f-8cb5-4961-9eca-fed5eada64bd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:47.837832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-20ac084f-8cb5-4961-9eca-fed5eada64bd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:47.854458 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-20ac084f-8cb5-4961-9eca-fed5eada64bd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:47.855341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-20ac084f-8cb5-4961-9eca-fed5eada64bd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:47.856379 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-20ac084f-8cb5-4961-9eca-fed5eada64bd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:47.857049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-20ac084f-8cb5-4961-9eca-fed5eada64bd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:48.044788 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-20ac084f-8cb5-4961-9eca-fed5eada64bd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lazy-loading 'services' on Instance uuid 46c73899-1dfd-4ce2-b988-681df43ef5e6 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:23:48.244662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-20ac084f-8cb5-4961-9eca-fed5eada64bd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "DELETE /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6/os-volume_attachments/d64d3d28-911c-44c0-bf06-c609d1a31b4a" status: 202 len: 0 microversion: 2.1 time: 0.412539 Jun 23 08:23:48.245945 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 234/456] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:23:47 2022] DELETE /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6/os-volume_attachments/d64d3d28-911c-44c0-bf06-c609d1a31b4a => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:23:48.634426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8dd5cc6a-d58e-4d64-8031-d6cdee683b3d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:48.635341 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8dd5cc6a-d58e-4d64-8031-d6cdee683b3d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:48.642540 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8dd5cc6a-d58e-4d64-8031-d6cdee683b3d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:48.643107 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8dd5cc6a-d58e-4d64-8031-d6cdee683b3d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:48.644001 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8dd5cc6a-d58e-4d64-8031-d6cdee683b3d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:48.644514 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8dd5cc6a-d58e-4d64-8031-d6cdee683b3d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:48.793718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8dd5cc6a-d58e-4d64-8031-d6cdee683b3d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:48.801792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8dd5cc6a-d58e-4d64-8031-d6cdee683b3d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.171259 Jun 23 08:23:48.802355 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 223/457] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:48 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:49.426963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-bab1275f-9687-4037-98bf-c3c766e581bd req-ff3d746c-933a-4c5a-9745-c19630fc64b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca4749e-9663-407f-a8fd-e58e91f7d55e", "name": "network-vif-plugged", "status": "completed", "tag": "cd2d7e86-3a51-4611-8caf-4bdf9ed2b077"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:49.432416 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:49.440377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-bab1275f-9687-4037-98bf-c3c766e581bd req-ff3d746c-933a-4c5a-9745-c19630fc64b0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:49.441076 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-bab1275f-9687-4037-98bf-c3c766e581bd req-ff3d746c-933a-4c5a-9745-c19630fc64b0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:49.461895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-bab1275f-9687-4037-98bf-c3c766e581bd req-ff3d746c-933a-4c5a-9745-c19630fc64b0 service nova] Creating event network-vif-plugged:cd2d7e86-3a51-4611-8caf-4bdf9ed2b077 for instance fca4749e-9663-407f-a8fd-e58e91f7d55e on hv-cinder-84721 Jun 23 08:23:49.467478 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-bab1275f-9687-4037-98bf-c3c766e581bd req-ff3d746c-933a-4c5a-9745-c19630fc64b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044670 Jun 23 08:23:49.468239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 235/458] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:23:49.673918 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1377001562", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:49.736434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] validate_networks() for None {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:23:49.821191 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f2f4dc86-260a-4ea6-a1b3-6dd0a83cf39b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:49.822631 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f2f4dc86-260a-4ea6-a1b3-6dd0a83cf39b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:49.830921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f2f4dc86-260a-4ea6-a1b3-6dd0a83cf39b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:49.831649 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f2f4dc86-260a-4ea6-a1b3-6dd0a83cf39b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:49.832963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f2f4dc86-260a-4ea6-a1b3-6dd0a83cf39b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:49.833781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f2f4dc86-260a-4ea6-a1b3-6dd0a83cf39b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:50.049160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f2f4dc86-260a-4ea6-a1b3-6dd0a83cf39b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:50.064463 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f2f4dc86-260a-4ea6-a1b3-6dd0a83cf39b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.247902 Jun 23 08:23:50.075768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 236/459] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:49 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:50.168179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:23:50.168591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:23:50.169051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:23:50.169453 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:23:50.169851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:23:50.195638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:50.195988 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:50.196770 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:50.197750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:50.216616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Getting quotas for project bf86466e66274193b5c2b0fdf69884b5. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:23:50.221198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Getting quotas for user 578195adbe574c67a6de17a17513f545 and project bf86466e66274193b5c2b0fdf69884b5. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:23:50.235248 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:23:50.237698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:23:50.286402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-03ef1366-4a65-429d-af54-c6941af554b7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616531 Jun 23 08:23:50.287023 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 224/460] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:23:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:23:50.297279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-32796e29-4f81-44dd-949c-1d5cc01e3a3b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:50.297934 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-32796e29-4f81-44dd-949c-1d5cc01e3a3b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:50.353451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-32796e29-4f81-44dd-949c-1d5cc01e3a3b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:50.361044 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-32796e29-4f81-44dd-949c-1d5cc01e3a3b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1215 microversion: 2.1 time: 0.067693 Jun 23 08:23:50.361837 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 237/461] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:50 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:51.084967 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ba9267ac-a50e-4323-b0f2-6197d302d0be tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:51.086297 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ba9267ac-a50e-4323-b0f2-6197d302d0be tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:51.098074 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba9267ac-a50e-4323-b0f2-6197d302d0be tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:51.099064 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba9267ac-a50e-4323-b0f2-6197d302d0be tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:51.101044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba9267ac-a50e-4323-b0f2-6197d302d0be tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:51.102160 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba9267ac-a50e-4323-b0f2-6197d302d0be tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:51.300782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ba9267ac-a50e-4323-b0f2-6197d302d0be tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:51.313745 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ba9267ac-a50e-4323-b0f2-6197d302d0be tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.231439 Jun 23 08:23:51.314720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 225/462] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:51 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:51.379932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-906aec03-5269-41d4-8ed5-40e0a2acd006 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:51.380578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-906aec03-5269-41d4-8ed5-40e0a2acd006 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:51.394693 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-906aec03-5269-41d4-8ed5-40e0a2acd006 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:51.395148 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-906aec03-5269-41d4-8ed5-40e0a2acd006 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:51.395975 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-906aec03-5269-41d4-8ed5-40e0a2acd006 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:51.396601 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-906aec03-5269-41d4-8ed5-40e0a2acd006 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:51.495158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-906aec03-5269-41d4-8ed5-40e0a2acd006 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:51.509836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-906aec03-5269-41d4-8ed5-40e0a2acd006 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1211 microversion: 2.1 time: 0.132091 Jun 23 08:23:51.512929 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 238/463] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:51 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1211 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:52.334239 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bfd05e19-3d5f-434d-be86-e56430df7f39 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:52.336072 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bfd05e19-3d5f-434d-be86-e56430df7f39 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:52.348291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bfd05e19-3d5f-434d-be86-e56430df7f39 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:52.349015 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bfd05e19-3d5f-434d-be86-e56430df7f39 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:52.350552 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bfd05e19-3d5f-434d-be86-e56430df7f39 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:52.351002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bfd05e19-3d5f-434d-be86-e56430df7f39 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:52.529518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7a330b67-8661-43d6-9e9e-07e7bfc19929 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:52.530826 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7a330b67-8661-43d6-9e9e-07e7bfc19929 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:52.538626 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7a330b67-8661-43d6-9e9e-07e7bfc19929 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:52.540058 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7a330b67-8661-43d6-9e9e-07e7bfc19929 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:52.541323 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7a330b67-8661-43d6-9e9e-07e7bfc19929 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:52.541992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7a330b67-8661-43d6-9e9e-07e7bfc19929 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:52.601832 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bfd05e19-3d5f-434d-be86-e56430df7f39 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:52.612344 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bfd05e19-3d5f-434d-be86-e56430df7f39 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1371 microversion: 2.1 time: 0.284529 Jun 23 08:23:52.614128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 226/464] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:52 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:52.652262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7a330b67-8661-43d6-9e9e-07e7bfc19929 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:52.672108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7a330b67-8661-43d6-9e9e-07e7bfc19929 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1267 microversion: 2.1 time: 0.147406 Jun 23 08:23:52.681899 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 239/465] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:52 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:53.630545 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4f51a754-c04b-4e83-b315-11b1591e9a0f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:53.631176 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4f51a754-c04b-4e83-b315-11b1591e9a0f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:53.642436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4f51a754-c04b-4e83-b315-11b1591e9a0f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:53.643132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4f51a754-c04b-4e83-b315-11b1591e9a0f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:53.644703 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4f51a754-c04b-4e83-b315-11b1591e9a0f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:53.647826 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4f51a754-c04b-4e83-b315-11b1591e9a0f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:53.689915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-090007df-c1b1-4df6-b3a6-585795c84252 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:53.697714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-090007df-c1b1-4df6-b3a6-585795c84252 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:53.711294 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-090007df-c1b1-4df6-b3a6-585795c84252 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:53.716074 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-090007df-c1b1-4df6-b3a6-585795c84252 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:53.717256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-090007df-c1b1-4df6-b3a6-585795c84252 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:53.717832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-090007df-c1b1-4df6-b3a6-585795c84252 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:53.841956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-090007df-c1b1-4df6-b3a6-585795c84252 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:53.843585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4f51a754-c04b-4e83-b315-11b1591e9a0f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:53.853664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-090007df-c1b1-4df6-b3a6-585795c84252 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1275 microversion: 2.1 time: 0.167772 Jun 23 08:23:53.858225 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4f51a754-c04b-4e83-b315-11b1591e9a0f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1564 microversion: 2.1 time: 0.231980 Jun 23 08:23:53.859311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 227/466] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:53 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1564 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:53.872274 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 240/467] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:53 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:53.879777 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-140ccd27-4ff7-4584-a3a7-6ff99933e349 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:53.880548 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-140ccd27-4ff7-4584-a3a7-6ff99933e349 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:53.889632 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-140ccd27-4ff7-4584-a3a7-6ff99933e349 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:53.890081 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-140ccd27-4ff7-4584-a3a7-6ff99933e349 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:53.891076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-140ccd27-4ff7-4584-a3a7-6ff99933e349 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:53.891727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-140ccd27-4ff7-4584-a3a7-6ff99933e349 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:53.991908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-140ccd27-4ff7-4584-a3a7-6ff99933e349 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117045 Jun 23 08:23:53.992696 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 228/468] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 08:23:53 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:23:54.870778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7b92c352-0cb6-46c8-8f50-ee528aeb4195 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:54.871685 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7b92c352-0cb6-46c8-8f50-ee528aeb4195 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:54.879285 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7b92c352-0cb6-46c8-8f50-ee528aeb4195 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:54.880018 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7b92c352-0cb6-46c8-8f50-ee528aeb4195 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:54.881112 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7b92c352-0cb6-46c8-8f50-ee528aeb4195 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:54.881944 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7b92c352-0cb6-46c8-8f50-ee528aeb4195 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:54.984529 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7b92c352-0cb6-46c8-8f50-ee528aeb4195 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:54.992615 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7b92c352-0cb6-46c8-8f50-ee528aeb4195 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1275 microversion: 2.1 time: 0.125835 Jun 23 08:23:54.993194 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 241/469] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:54 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:55.708064 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-fd2f8dd2-0a71-4a84-b5db-73e47068e7ef req-1264e4d6-d12e-409d-abb8-b0931956f019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca4749e-9663-407f-a8fd-e58e91f7d55e", "tag": "cd2d7e86-3a51-4611-8caf-4bdf9ed2b077"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:23:55.717014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-fd2f8dd2-0a71-4a84-b5db-73e47068e7ef req-1264e4d6-d12e-409d-abb8-b0931956f019 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:55.717459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-fd2f8dd2-0a71-4a84-b5db-73e47068e7ef req-1264e4d6-d12e-409d-abb8-b0931956f019 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:55.729259 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-fd2f8dd2-0a71-4a84-b5db-73e47068e7ef req-1264e4d6-d12e-409d-abb8-b0931956f019 service nova] Creating event network-changed:cd2d7e86-3a51-4611-8caf-4bdf9ed2b077 for instance fca4749e-9663-407f-a8fd-e58e91f7d55e on hv-cinder-84721 Jun 23 08:23:55.735421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-fd2f8dd2-0a71-4a84-b5db-73e47068e7ef req-1264e4d6-d12e-409d-abb8-b0931956f019 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031366 Jun 23 08:23:55.741049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 229/470] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:23:56.010342 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-27cb9eb3-95b1-4994-a989-c658f5726c9c tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:56.010992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-27cb9eb3-95b1-4994-a989-c658f5726c9c tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:56.018776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-27cb9eb3-95b1-4994-a989-c658f5726c9c tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:56.019241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-27cb9eb3-95b1-4994-a989-c658f5726c9c tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:56.020033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-27cb9eb3-95b1-4994-a989-c658f5726c9c tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:56.020493 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-27cb9eb3-95b1-4994-a989-c658f5726c9c tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:56.037519 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:23:56.143350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-27cb9eb3-95b1-4994-a989-c658f5726c9c tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:56.153010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-27cb9eb3-95b1-4994-a989-c658f5726c9c tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1275 microversion: 2.1 time: 0.146828 Jun 23 08:23:56.167702 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 242/471] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:56 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:57.185781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ba7293b8-61bf-4d9c-899f-5aba04e6adc8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:57.186507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ba7293b8-61bf-4d9c-899f-5aba04e6adc8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:57.193515 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba7293b8-61bf-4d9c-899f-5aba04e6adc8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:57.194042 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba7293b8-61bf-4d9c-899f-5aba04e6adc8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:57.194826 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba7293b8-61bf-4d9c-899f-5aba04e6adc8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:57.195450 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba7293b8-61bf-4d9c-899f-5aba04e6adc8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:57.261924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ba7293b8-61bf-4d9c-899f-5aba04e6adc8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:57.269410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ba7293b8-61bf-4d9c-899f-5aba04e6adc8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1275 microversion: 2.1 time: 0.088946 Jun 23 08:23:57.269973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 230/472] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:57 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:58.286443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-251c9a80-4888-46c8-9800-be36a23494a9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:58.287052 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-251c9a80-4888-46c8-9800-be36a23494a9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:58.294241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-251c9a80-4888-46c8-9800-be36a23494a9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:58.294784 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-251c9a80-4888-46c8-9800-be36a23494a9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:58.296001 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-251c9a80-4888-46c8-9800-be36a23494a9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:58.296001 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-251c9a80-4888-46c8-9800-be36a23494a9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:58.359451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-251c9a80-4888-46c8-9800-be36a23494a9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:58.376760 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-251c9a80-4888-46c8-9800-be36a23494a9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1275 microversion: 2.1 time: 0.093831 Jun 23 08:23:58.378020 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 243/473] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:58 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:23:59.394724 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-99498945-e626-4cf8-922a-d04b488099cd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:23:59.396242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-99498945-e626-4cf8-922a-d04b488099cd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:23:59.404131 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-99498945-e626-4cf8-922a-d04b488099cd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:59.404835 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-99498945-e626-4cf8-922a-d04b488099cd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:59.405615 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-99498945-e626-4cf8-922a-d04b488099cd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:23:59.406182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-99498945-e626-4cf8-922a-d04b488099cd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:23:59.491803 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-99498945-e626-4cf8-922a-d04b488099cd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:23:59.501207 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-99498945-e626-4cf8-922a-d04b488099cd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1273 microversion: 2.1 time: 0.110201 Jun 23 08:23:59.502369 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 231/474] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:23:59 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:00.129151 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f29f6a4d-b5fb-4b9f-8b4b-42ca168e050e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: .version_select at 0x7feb68199dc0>, body: {"keypair": {"name": "tempest-keypair-1183755753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlcfYzZAStqWFz9sdcfNjU5kl7ULW7jnqUCJ17mmxdGdj6AbRZ+3dusIchmufqMzKgNfVuWxI1oIPy95bPRUGqojHKlIfp2h+5o0BA+fQ5dpRseU3fQkskINkZr5/8e+A=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:00.148019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-f29f6a4d-b5fb-4b9f-8b4b-42ca168e050e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for project 4979d926d8894e3db358f16bd6bf7621. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:24:00.153423 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-f29f6a4d-b5fb-4b9f-8b4b-42ca168e050e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for user 938efacddf794fd18cd323043906b6c1 and project 4979d926d8894e3db358f16bd6bf7621. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:24:00.184461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f29f6a4d-b5fb-4b9f-8b4b-42ca168e050e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059544 Jun 23 08:24:00.185064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 244/475] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:24:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:24:00.522778 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-482b24fc-b73f-4ad1-9c16-d8640f627c68 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:00.523818 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-482b24fc-b73f-4ad1-9c16-d8640f627c68 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:00.546104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:00.547257 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:00.548812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:00.554326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-482b24fc-b73f-4ad1-9c16-d8640f627c68 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:00.556455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-482b24fc-b73f-4ad1-9c16-d8640f627c68 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:00.566128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-482b24fc-b73f-4ad1-9c16-d8640f627c68 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:00.566683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-482b24fc-b73f-4ad1-9c16-d8640f627c68 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:00.617968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=95 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:01.120101 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-482b24fc-b73f-4ad1-9c16-d8640f627c68 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:01.128459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-482b24fc-b73f-4ad1-9c16-d8640f627c68 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.610655 Jun 23 08:24:01.129374 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 232/476] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:00 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:01.582092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4bfadf37-caec-41fb-8083-f9b29f13efb5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:01.583188 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4bfadf37-caec-41fb-8083-f9b29f13efb5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:01.590383 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4bfadf37-caec-41fb-8083-f9b29f13efb5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:01.591401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4bfadf37-caec-41fb-8083-f9b29f13efb5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:01.592183 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4bfadf37-caec-41fb-8083-f9b29f13efb5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:01.592660 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4bfadf37-caec-41fb-8083-f9b29f13efb5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:01.620309 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4bfadf37-caec-41fb-8083-f9b29f13efb5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:24:01.712712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4bfadf37-caec-41fb-8083-f9b29f13efb5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "DELETE /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 204 len: 0 microversion: 2.1 time: 0.134547 Jun 23 08:24:01.713776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 245/477] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:24:01 2022] DELETE /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:24:01.722223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-24fbad11-643e-4dad-96c7-511d58540543 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:01.722851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-24fbad11-643e-4dad-96c7-511d58540543 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:01.729099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-24fbad11-643e-4dad-96c7-511d58540543 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:01.729765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-24fbad11-643e-4dad-96c7-511d58540543 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:01.730712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-24fbad11-643e-4dad-96c7-511d58540543 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:01.731318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-24fbad11-643e-4dad-96c7-511d58540543 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:02.031472 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-6d1b6173-20e4-4873-b98e-8cc3b04bf046 req-8e33dcab-1747-4fa0-98c3-5bdb3a6c9ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b633ac69-2692-493b-832c-15eabce9ecf0", "tag": "174a2882-7714-4c7b-bee8-c77dc51a32d1"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:02.041283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-6d1b6173-20e4-4873-b98e-8cc3b04bf046 req-8e33dcab-1747-4fa0-98c3-5bdb3a6c9ac3 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:02.041722 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-6d1b6173-20e4-4873-b98e-8cc3b04bf046 req-8e33dcab-1747-4fa0-98c3-5bdb3a6c9ac3 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:02.078618 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-6d1b6173-20e4-4873-b98e-8cc3b04bf046 req-8e33dcab-1747-4fa0-98c3-5bdb3a6c9ac3 service nova] Creating event network-changed:174a2882-7714-4c7b-bee8-c77dc51a32d1 for instance b633ac69-2692-493b-832c-15eabce9ecf0 on hv-cinder-84721 Jun 23 08:24:02.092460 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-6d1b6173-20e4-4873-b98e-8cc3b04bf046 req-8e33dcab-1747-4fa0-98c3-5bdb3a6c9ac3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064903 Jun 23 08:24:02.093072 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 246/478] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:02.104210 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-24fbad11-643e-4dad-96c7-511d58540543 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:02.106966 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-119349117", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b65b84c3-0a03-45d3-ab3d-aba7b8f8cc03"}], "security_groups": [{"name": "tempest-securitygroup--125808659"}], "key_name": "tempest-keypair-1183755753", "user_data": "}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:02.123625 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-24fbad11-643e-4dad-96c7-511d58540543 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1514 microversion: 2.1 time: 0.405795 Jun 23 08:24:02.125708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 233/479] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:01 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1514 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:02.151177 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9379d2a5-e20f-4889-b49d-6efad12b4142 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:02.168729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9379d2a5-e20f-4889-b49d-6efad12b4142 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:02.180132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9379d2a5-e20f-4889-b49d-6efad12b4142 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:02.181690 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9379d2a5-e20f-4889-b49d-6efad12b4142 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:02.189583 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9379d2a5-e20f-4889-b49d-6efad12b4142 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:02.191601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9379d2a5-e20f-4889-b49d-6efad12b4142 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:02.303833 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.network.neutron [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] validate_networks() for [('b65b84c3-0a03-45d3-ab3d-aba7b8f8cc03', None, None, None, None, None)] {{(pid=117758) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:24:02.387035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9379d2a5-e20f-4889-b49d-6efad12b4142 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:02.397211 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9379d2a5-e20f-4889-b49d-6efad12b4142 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.250115 Jun 23 08:24:02.398144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 234/480] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:02 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:02.823962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Flavor limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:24:02.825335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Image limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:24:02.825433 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Flavor pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:24:02.825840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Image pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:24:02.827265 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:24:02.838996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:02.840167 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:02.840870 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:02.841476 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:02.859138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for project 4979d926d8894e3db358f16bd6bf7621. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:24:02.863558 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for user 938efacddf794fd18cd323043906b6c1 and project 4979d926d8894e3db358f16bd6bf7621. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:24:02.880975 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Going to run 1 instances... {{(pid=117758) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:24:02.883554 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:24:02.934038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-07338fda-29fe-4672-b910-c048b0422276 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.836474 Jun 23 08:24:02.934954 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 247/481] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:24:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:24:02.944969 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-aced18d0-4190-4297-a6d0-8364035afbec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:02.945590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-aced18d0-4190-4297-a6d0-8364035afbec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:03.008336 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-aced18d0-4190-4297-a6d0-8364035afbec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:03.018004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-aced18d0-4190-4297-a6d0-8364035afbec tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1241 microversion: 2.1 time: 0.076814 Jun 23 08:24:03.018767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 235/482] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:02 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:03.143302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-56b72aae-83bb-4b39-93d9-7c754c2b076b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:03.144772 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-56b72aae-83bb-4b39-93d9-7c754c2b076b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:03.153665 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-56b72aae-83bb-4b39-93d9-7c754c2b076b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:03.154068 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-56b72aae-83bb-4b39-93d9-7c754c2b076b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:03.158407 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-56b72aae-83bb-4b39-93d9-7c754c2b076b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:03.159577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-56b72aae-83bb-4b39-93d9-7c754c2b076b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:03.310044 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-56b72aae-83bb-4b39-93d9-7c754c2b076b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:03.321860 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-56b72aae-83bb-4b39-93d9-7c754c2b076b tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1514 microversion: 2.1 time: 0.182539 Jun 23 08:24:03.322758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 248/483] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:03 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:03.413682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-10590bf8-9e80-47bb-83f5-77a33f549434 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:03.414289 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-10590bf8-9e80-47bb-83f5-77a33f549434 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:03.426330 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-10590bf8-9e80-47bb-83f5-77a33f549434 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:03.426783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-10590bf8-9e80-47bb-83f5-77a33f549434 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:03.427588 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-10590bf8-9e80-47bb-83f5-77a33f549434 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:03.428025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-10590bf8-9e80-47bb-83f5-77a33f549434 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:03.593413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-10590bf8-9e80-47bb-83f5-77a33f549434 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:03.601370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-10590bf8-9e80-47bb-83f5-77a33f549434 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.191522 Jun 23 08:24:03.602207 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 236/484] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:03 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:04.035538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9d4c5ff0-ad49-462b-b74d-f2f2ebf29183 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:04.036168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9d4c5ff0-ad49-462b-b74d-f2f2ebf29183 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:04.044048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9d4c5ff0-ad49-462b-b74d-f2f2ebf29183 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:04.044756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9d4c5ff0-ad49-462b-b74d-f2f2ebf29183 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:04.045701 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9d4c5ff0-ad49-462b-b74d-f2f2ebf29183 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:04.046138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9d4c5ff0-ad49-462b-b74d-f2f2ebf29183 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:04.115982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9d4c5ff0-ad49-462b-b74d-f2f2ebf29183 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:04.124623 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9d4c5ff0-ad49-462b-b74d-f2f2ebf29183 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1293 microversion: 2.1 time: 0.093307 Jun 23 08:24:04.125193 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 249/485] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:04 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:04.348163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-39fb4505-16dc-4de1-9df6-66eb22914c36 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:04.349224 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-39fb4505-16dc-4de1-9df6-66eb22914c36 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:04.357740 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-39fb4505-16dc-4de1-9df6-66eb22914c36 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:04.358672 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-39fb4505-16dc-4de1-9df6-66eb22914c36 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:04.359859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-39fb4505-16dc-4de1-9df6-66eb22914c36 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:04.360361 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-39fb4505-16dc-4de1-9df6-66eb22914c36 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:04.619030 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9af37195-93d0-436c-87df-620b8df3d1e8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:04.619847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9af37195-93d0-436c-87df-620b8df3d1e8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:04.630014 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9af37195-93d0-436c-87df-620b8df3d1e8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:04.630562 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9af37195-93d0-436c-87df-620b8df3d1e8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:04.631628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9af37195-93d0-436c-87df-620b8df3d1e8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:04.633220 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9af37195-93d0-436c-87df-620b8df3d1e8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:04.820365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9af37195-93d0-436c-87df-620b8df3d1e8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:04.830133 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9af37195-93d0-436c-87df-620b8df3d1e8 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.215663 Jun 23 08:24:04.830891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 250/486] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:04 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:04.849103 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-39fb4505-16dc-4de1-9df6-66eb22914c36 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:04.867572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-39fb4505-16dc-4de1-9df6-66eb22914c36 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1514 microversion: 2.1 time: 0.531732 Jun 23 08:24:04.886263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 237/487] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:04 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1514 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:05.142315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bee09e35-85fd-4405-a968-97a213b81f03 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:05.142959 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bee09e35-85fd-4405-a968-97a213b81f03 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:05.150938 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bee09e35-85fd-4405-a968-97a213b81f03 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:05.151450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bee09e35-85fd-4405-a968-97a213b81f03 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:05.152341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bee09e35-85fd-4405-a968-97a213b81f03 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:05.152955 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bee09e35-85fd-4405-a968-97a213b81f03 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:05.250614 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bee09e35-85fd-4405-a968-97a213b81f03 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:05.258782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bee09e35-85fd-4405-a968-97a213b81f03 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1299 microversion: 2.1 time: 0.121090 Jun 23 08:24:05.259703 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 251/488] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:05 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:05.518309 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-ac5a7042-d6db-4b62-955a-5dedff70f0d0 req-09aa1cd5-9bee-44ca-ba59-879fef4df85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c73899-1dfd-4ce2-b988-681df43ef5e6", "name": "network-vif-deleted", "tag": "b573fb6b-6e0a-4c90-ab3c-be2c12dcf1ad"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:05.528825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-ac5a7042-d6db-4b62-955a-5dedff70f0d0 req-09aa1cd5-9bee-44ca-ba59-879fef4df85b service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:05.529513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-ac5a7042-d6db-4b62-955a-5dedff70f0d0 req-09aa1cd5-9bee-44ca-ba59-879fef4df85b service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:05.543496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-ac5a7042-d6db-4b62-955a-5dedff70f0d0 req-09aa1cd5-9bee-44ca-ba59-879fef4df85b service nova] Creating event network-vif-deleted:b573fb6b-6e0a-4c90-ab3c-be2c12dcf1ad for instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 on hv-cinder-84721 Jun 23 08:24:05.548662 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-ac5a7042-d6db-4b62-955a-5dedff70f0d0 req-09aa1cd5-9bee-44ca-ba59-879fef4df85b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034216 Jun 23 08:24:05.549444 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 238/489] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:05.849314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-783fbfac-3538-42af-8327-d146e16ba116 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:05.849975 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-783fbfac-3538-42af-8327-d146e16ba116 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:05.858531 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-783fbfac-3538-42af-8327-d146e16ba116 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:05.859361 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-783fbfac-3538-42af-8327-d146e16ba116 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:05.860586 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-783fbfac-3538-42af-8327-d146e16ba116 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:05.860996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-783fbfac-3538-42af-8327-d146e16ba116 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:05.907951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-fbfca6ac-6ced-4df2-9d0e-4fdb683927a7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:05.909102 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-fbfca6ac-6ced-4df2-9d0e-4fdb683927a7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:05.922620 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fbfca6ac-6ced-4df2-9d0e-4fdb683927a7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:05.923818 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fbfca6ac-6ced-4df2-9d0e-4fdb683927a7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:05.926398 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fbfca6ac-6ced-4df2-9d0e-4fdb683927a7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:05.927465 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fbfca6ac-6ced-4df2-9d0e-4fdb683927a7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:06.046136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fbfca6ac-6ced-4df2-9d0e-4fdb683927a7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:06.058641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-fbfca6ac-6ced-4df2-9d0e-4fdb683927a7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.168192 Jun 23 08:24:06.069625 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 239/490] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:05 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:06.081918 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-783fbfac-3538-42af-8327-d146e16ba116 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:06.090386 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-783fbfac-3538-42af-8327-d146e16ba116 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.245970 Jun 23 08:24:06.092008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 252/491] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:05 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:06.276614 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3ddd7ca1-42c8-401a-8aed-f63462c0e473 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:06.277206 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3ddd7ca1-42c8-401a-8aed-f63462c0e473 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:06.283056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3ddd7ca1-42c8-401a-8aed-f63462c0e473 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:06.283739 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3ddd7ca1-42c8-401a-8aed-f63462c0e473 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:06.284480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3ddd7ca1-42c8-401a-8aed-f63462c0e473 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:06.284904 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3ddd7ca1-42c8-401a-8aed-f63462c0e473 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:06.431855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3ddd7ca1-42c8-401a-8aed-f63462c0e473 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:06.439550 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3ddd7ca1-42c8-401a-8aed-f63462c0e473 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.166693 Jun 23 08:24:06.440052 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 240/492] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:06 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:07.076198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-be5f56f8-64de-4d62-82f5-61b2498ca0b9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:07.076784 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-be5f56f8-64de-4d62-82f5-61b2498ca0b9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:07.083613 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be5f56f8-64de-4d62-82f5-61b2498ca0b9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:07.084051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be5f56f8-64de-4d62-82f5-61b2498ca0b9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:07.084787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be5f56f8-64de-4d62-82f5-61b2498ca0b9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:07.085233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be5f56f8-64de-4d62-82f5-61b2498ca0b9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:07.108358 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-44cfb3a3-6151-4798-9699-396a6c93c8b4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:07.108948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-44cfb3a3-6151-4798-9699-396a6c93c8b4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:07.115274 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-44cfb3a3-6151-4798-9699-396a6c93c8b4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:07.115706 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-44cfb3a3-6151-4798-9699-396a6c93c8b4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:07.116522 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-44cfb3a3-6151-4798-9699-396a6c93c8b4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:07.117235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-44cfb3a3-6151-4798-9699-396a6c93c8b4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:07.150652 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-be5f56f8-64de-4d62-82f5-61b2498ca0b9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:07.159532 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-be5f56f8-64de-4d62-82f5-61b2498ca0b9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.087036 Jun 23 08:24:07.160385 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 253/493] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:07 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:07.267410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-44cfb3a3-6151-4798-9699-396a6c93c8b4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:07.275153 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-44cfb3a3-6151-4798-9699-396a6c93c8b4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.170616 Jun 23 08:24:07.275893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 241/494] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:07 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:07.456799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d5fff94a-e0d1-4cd5-8b88-327d14b1245d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:07.457401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d5fff94a-e0d1-4cd5-8b88-327d14b1245d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:07.464000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d5fff94a-e0d1-4cd5-8b88-327d14b1245d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:07.464417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d5fff94a-e0d1-4cd5-8b88-327d14b1245d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:07.465180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d5fff94a-e0d1-4cd5-8b88-327d14b1245d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:07.465599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d5fff94a-e0d1-4cd5-8b88-327d14b1245d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:07.597884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d5fff94a-e0d1-4cd5-8b88-327d14b1245d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:07.607180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d5fff94a-e0d1-4cd5-8b88-327d14b1245d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.154191 Jun 23 08:24:07.607782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 254/495] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:07 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:08.181055 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-12fa9677-0d78-4ed3-a6a7-8aab6463e532 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:08.181658 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-12fa9677-0d78-4ed3-a6a7-8aab6463e532 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:08.188861 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12fa9677-0d78-4ed3-a6a7-8aab6463e532 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:08.189329 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12fa9677-0d78-4ed3-a6a7-8aab6463e532 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:08.190115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12fa9677-0d78-4ed3-a6a7-8aab6463e532 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:08.190564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-12fa9677-0d78-4ed3-a6a7-8aab6463e532 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:08.257126 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-12fa9677-0d78-4ed3-a6a7-8aab6463e532 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:08.265209 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-12fa9677-0d78-4ed3-a6a7-8aab6463e532 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.090611 Jun 23 08:24:08.266000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 242/496] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:08 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:08.297880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a0e0a59c-0e19-4c93-8145-4b4a82e8fcd9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:08.298487 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a0e0a59c-0e19-4c93-8145-4b4a82e8fcd9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:08.305314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a0e0a59c-0e19-4c93-8145-4b4a82e8fcd9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:08.305716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a0e0a59c-0e19-4c93-8145-4b4a82e8fcd9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:08.306662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a0e0a59c-0e19-4c93-8145-4b4a82e8fcd9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:08.307131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a0e0a59c-0e19-4c93-8145-4b4a82e8fcd9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:08.440158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a0e0a59c-0e19-4c93-8145-4b4a82e8fcd9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:08.448224 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a0e0a59c-0e19-4c93-8145-4b4a82e8fcd9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.154140 Jun 23 08:24:08.448775 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 255/497] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:08 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:08.629094 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c28ad472-29d6-4b24-a176-ebaae6db4074 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:08.630089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c28ad472-29d6-4b24-a176-ebaae6db4074 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:08.640633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c28ad472-29d6-4b24-a176-ebaae6db4074 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:08.641385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c28ad472-29d6-4b24-a176-ebaae6db4074 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:08.642643 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c28ad472-29d6-4b24-a176-ebaae6db4074 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:08.643432 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c28ad472-29d6-4b24-a176-ebaae6db4074 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:08.789210 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c28ad472-29d6-4b24-a176-ebaae6db4074 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:08.800647 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c28ad472-29d6-4b24-a176-ebaae6db4074 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.178024 Jun 23 08:24:08.801433 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 243/498] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:08 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:09.285938 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d0949909-b134-4327-a32b-a76a80731e08 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:09.287039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d0949909-b134-4327-a32b-a76a80731e08 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:09.295407 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0949909-b134-4327-a32b-a76a80731e08 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:09.295850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0949909-b134-4327-a32b-a76a80731e08 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:09.296620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0949909-b134-4327-a32b-a76a80731e08 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:09.297051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0949909-b134-4327-a32b-a76a80731e08 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:09.362491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d0949909-b134-4327-a32b-a76a80731e08 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:09.370405 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d0949909-b134-4327-a32b-a76a80731e08 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.090882 Jun 23 08:24:09.370973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 256/499] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:09 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:09.465434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b8180baf-0b93-4b23-b14f-289a301cdcfb tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:09.466032 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b8180baf-0b93-4b23-b14f-289a301cdcfb tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:09.473271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b8180baf-0b93-4b23-b14f-289a301cdcfb tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:09.473712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b8180baf-0b93-4b23-b14f-289a301cdcfb tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:09.474503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b8180baf-0b93-4b23-b14f-289a301cdcfb tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:09.475068 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b8180baf-0b93-4b23-b14f-289a301cdcfb tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:09.606934 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b8180baf-0b93-4b23-b14f-289a301cdcfb tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:09.615126 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b8180baf-0b93-4b23-b14f-289a301cdcfb tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.153626 Jun 23 08:24:09.615723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 244/500] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:09 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:09.821686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-deb8c6ea-87ee-4c02-b86d-47480e65dde1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:09.822214 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-deb8c6ea-87ee-4c02-b86d-47480e65dde1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:09.828748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-deb8c6ea-87ee-4c02-b86d-47480e65dde1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:09.829186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-deb8c6ea-87ee-4c02-b86d-47480e65dde1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:09.829944 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-deb8c6ea-87ee-4c02-b86d-47480e65dde1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:09.830368 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-deb8c6ea-87ee-4c02-b86d-47480e65dde1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:09.957754 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-deb8c6ea-87ee-4c02-b86d-47480e65dde1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:09.965672 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-deb8c6ea-87ee-4c02-b86d-47480e65dde1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.150529 Jun 23 08:24:09.966228 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 257/501] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:09 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:10.388032 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f1bd9822-316a-43d9-a338-35157b4658eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:10.388634 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f1bd9822-316a-43d9-a338-35157b4658eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:10.395549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f1bd9822-316a-43d9-a338-35157b4658eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:10.395992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f1bd9822-316a-43d9-a338-35157b4658eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:10.396745 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f1bd9822-316a-43d9-a338-35157b4658eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:10.397173 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f1bd9822-316a-43d9-a338-35157b4658eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:10.458973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f1bd9822-316a-43d9-a338-35157b4658eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:10.468585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f1bd9822-316a-43d9-a338-35157b4658eb tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.084393 Jun 23 08:24:10.469217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 245/502] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:10 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:10.636100 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c653570d-a04b-4123-ac6f-b7ff32e2a1bd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:10.636714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c653570d-a04b-4123-ac6f-b7ff32e2a1bd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:10.644927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c653570d-a04b-4123-ac6f-b7ff32e2a1bd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:10.645444 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c653570d-a04b-4123-ac6f-b7ff32e2a1bd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:10.646324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c653570d-a04b-4123-ac6f-b7ff32e2a1bd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:10.646842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c653570d-a04b-4123-ac6f-b7ff32e2a1bd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:10.788328 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c653570d-a04b-4123-ac6f-b7ff32e2a1bd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:10.797032 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c653570d-a04b-4123-ac6f-b7ff32e2a1bd tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.166722 Jun 23 08:24:10.797594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 258/503] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:10 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:10.984018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d5cde8a4-f240-448d-b851-34abcf30a126 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:10.985465 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d5cde8a4-f240-448d-b851-34abcf30a126 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:10.992341 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d5cde8a4-f240-448d-b851-34abcf30a126 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:10.992865 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d5cde8a4-f240-448d-b851-34abcf30a126 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:10.994449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d5cde8a4-f240-448d-b851-34abcf30a126 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:10.995020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d5cde8a4-f240-448d-b851-34abcf30a126 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:11.130270 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d5cde8a4-f240-448d-b851-34abcf30a126 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:11.138075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d5cde8a4-f240-448d-b851-34abcf30a126 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.158413 Jun 23 08:24:11.138669 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 246/504] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:10 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:11.490016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6b0d05c1-637c-4909-91b6-dc92e2e70d64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:11.490739 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6b0d05c1-637c-4909-91b6-dc92e2e70d64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:11.500027 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b0d05c1-637c-4909-91b6-dc92e2e70d64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:11.500682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b0d05c1-637c-4909-91b6-dc92e2e70d64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:11.501719 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b0d05c1-637c-4909-91b6-dc92e2e70d64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:11.502345 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6b0d05c1-637c-4909-91b6-dc92e2e70d64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:11.523419 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:11.570435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6b0d05c1-637c-4909-91b6-dc92e2e70d64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:11.578750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6b0d05c1-637c-4909-91b6-dc92e2e70d64 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.094073 Jun 23 08:24:11.579317 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 259/505] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:11 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:11.814858 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6e0b2ae4-86f1-4afd-93f9-13b90b321b43 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:11.815485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6e0b2ae4-86f1-4afd-93f9-13b90b321b43 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:11.822641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e0b2ae4-86f1-4afd-93f9-13b90b321b43 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:11.823133 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e0b2ae4-86f1-4afd-93f9-13b90b321b43 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:11.823995 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e0b2ae4-86f1-4afd-93f9-13b90b321b43 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:11.824470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e0b2ae4-86f1-4afd-93f9-13b90b321b43 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:11.954950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6e0b2ae4-86f1-4afd-93f9-13b90b321b43 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:11.962658 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6e0b2ae4-86f1-4afd-93f9-13b90b321b43 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.152096 Jun 23 08:24:11.963193 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 247/506] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:11 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:12.158959 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b2095d3f-5298-4ba8-8298-db16dc0d25f6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:12.159960 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b2095d3f-5298-4ba8-8298-db16dc0d25f6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:12.168966 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2095d3f-5298-4ba8-8298-db16dc0d25f6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:12.169407 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2095d3f-5298-4ba8-8298-db16dc0d25f6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:12.170162 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2095d3f-5298-4ba8-8298-db16dc0d25f6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:12.170584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2095d3f-5298-4ba8-8298-db16dc0d25f6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:12.311194 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b2095d3f-5298-4ba8-8298-db16dc0d25f6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:12.319951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b2095d3f-5298-4ba8-8298-db16dc0d25f6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.167408 Jun 23 08:24:12.320510 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 260/507] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:12 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:12.596536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1b38e940-92bd-49b3-805f-9b1459ea21b7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:12.597151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1b38e940-92bd-49b3-805f-9b1459ea21b7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:12.604199 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1b38e940-92bd-49b3-805f-9b1459ea21b7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:12.604639 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1b38e940-92bd-49b3-805f-9b1459ea21b7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:12.605398 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1b38e940-92bd-49b3-805f-9b1459ea21b7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:12.605828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1b38e940-92bd-49b3-805f-9b1459ea21b7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:12.667238 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1b38e940-92bd-49b3-805f-9b1459ea21b7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:12.675376 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1b38e940-92bd-49b3-805f-9b1459ea21b7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.082709 Jun 23 08:24:12.675977 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 248/508] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:12 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:12.981180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2b680103-1fa6-4163-a747-48cd794fbe49 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:12.981806 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2b680103-1fa6-4163-a747-48cd794fbe49 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:12.983671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:12.984339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=12 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:12.990571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b680103-1fa6-4163-a747-48cd794fbe49 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:12.991007 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b680103-1fa6-4163-a747-48cd794fbe49 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:12.991834 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b680103-1fa6-4163-a747-48cd794fbe49 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:12.992257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b680103-1fa6-4163-a747-48cd794fbe49 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:13.139647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2b680103-1fa6-4163-a747-48cd794fbe49 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:13.147641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2b680103-1fa6-4163-a747-48cd794fbe49 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.170973 Jun 23 08:24:13.148209 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 261/509] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:12 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:13.337832 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-260bd393-60b5-4065-99ec-095a0f74071c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:13.338415 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-260bd393-60b5-4065-99ec-095a0f74071c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:13.340654 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:13.346939 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-260bd393-60b5-4065-99ec-095a0f74071c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:13.347398 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-260bd393-60b5-4065-99ec-095a0f74071c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:13.348255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-260bd393-60b5-4065-99ec-095a0f74071c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:13.348683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-260bd393-60b5-4065-99ec-095a0f74071c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:13.491737 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-260bd393-60b5-4065-99ec-095a0f74071c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:13.500238 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-260bd393-60b5-4065-99ec-095a0f74071c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.166358 Jun 23 08:24:13.500814 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 249/510] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:13 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:13.697170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f41cc731-1393-443c-89f5-bc11309a4fab tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:13.697745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f41cc731-1393-443c-89f5-bc11309a4fab tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:13.704807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f41cc731-1393-443c-89f5-bc11309a4fab tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:13.705252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f41cc731-1393-443c-89f5-bc11309a4fab tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:13.706021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f41cc731-1393-443c-89f5-bc11309a4fab tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:13.706451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f41cc731-1393-443c-89f5-bc11309a4fab tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:13.769981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f41cc731-1393-443c-89f5-bc11309a4fab tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:13.781571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f41cc731-1393-443c-89f5-bc11309a4fab tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.090824 Jun 23 08:24:13.782347 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 262/511] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:13 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:14.168016 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-06c7b90d-7540-4790-b333-9632b3e7c731 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:14.168917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-06c7b90d-7540-4790-b333-9632b3e7c731 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:14.179595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06c7b90d-7540-4790-b333-9632b3e7c731 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:14.180241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06c7b90d-7540-4790-b333-9632b3e7c731 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:14.181247 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06c7b90d-7540-4790-b333-9632b3e7c731 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:14.181675 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06c7b90d-7540-4790-b333-9632b3e7c731 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:14.196402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:14.317298 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-06c7b90d-7540-4790-b333-9632b3e7c731 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:14.325172 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-06c7b90d-7540-4790-b333-9632b3e7c731 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.163473 Jun 23 08:24:14.325727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 250/512] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:14 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:14.518787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-37afe193-b468-4d71-981f-d88d868248a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:14.519457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-37afe193-b468-4d71-981f-d88d868248a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:14.526842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-37afe193-b468-4d71-981f-d88d868248a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:14.527309 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-37afe193-b468-4d71-981f-d88d868248a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:14.528070 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-37afe193-b468-4d71-981f-d88d868248a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:14.528497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-37afe193-b468-4d71-981f-d88d868248a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:14.697300 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-37afe193-b468-4d71-981f-d88d868248a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:14.708810 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-37afe193-b468-4d71-981f-d88d868248a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.193824 Jun 23 08:24:14.709683 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 263/513] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:14 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:14.799089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c2ea1ec3-00a8-4a31-9dec-6847e2e18d2c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:14.799726 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c2ea1ec3-00a8-4a31-9dec-6847e2e18d2c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:14.806374 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ec3-00a8-4a31-9dec-6847e2e18d2c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:14.806816 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ec3-00a8-4a31-9dec-6847e2e18d2c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:14.807619 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ec3-00a8-4a31-9dec-6847e2e18d2c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:14.808036 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ec3-00a8-4a31-9dec-6847e2e18d2c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:14.879054 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c2ea1ec3-00a8-4a31-9dec-6847e2e18d2c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:14.887648 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c2ea1ec3-00a8-4a31-9dec-6847e2e18d2c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1472 microversion: 2.1 time: 0.092356 Jun 23 08:24:14.888236 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 251/514] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:14 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:15.346128 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-56a279ca-97fb-4616-a3a6-b639bb4ad0b9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:15.346982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-56a279ca-97fb-4616-a3a6-b639bb4ad0b9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:15.357243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-56a279ca-97fb-4616-a3a6-b639bb4ad0b9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:15.358026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-56a279ca-97fb-4616-a3a6-b639bb4ad0b9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:15.359281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-56a279ca-97fb-4616-a3a6-b639bb4ad0b9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:15.360031 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-56a279ca-97fb-4616-a3a6-b639bb4ad0b9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:15.503807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-56a279ca-97fb-4616-a3a6-b639bb4ad0b9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:15.511747 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-56a279ca-97fb-4616-a3a6-b639bb4ad0b9 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.172207 Jun 23 08:24:15.512361 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 264/515] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:15 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:15.733439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cfd3451f-7d8e-4e4f-ac8c-c019f0fc977a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:15.734370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cfd3451f-7d8e-4e4f-ac8c-c019f0fc977a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:15.743138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfd3451f-7d8e-4e4f-ac8c-c019f0fc977a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:15.743621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfd3451f-7d8e-4e4f-ac8c-c019f0fc977a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:15.744524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfd3451f-7d8e-4e4f-ac8c-c019f0fc977a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:15.744965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfd3451f-7d8e-4e4f-ac8c-c019f0fc977a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:15.904769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:15.905839 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:15.915312 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:15.916073 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:15.917241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:15.919367 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:15.958801 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:15.959154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:15.959625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lazy-loading 'fault' on Instance uuid 46c73899-1dfd-4ce2-b988-681df43ef5e6 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:24:16.000603 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:16.008505 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cbee4325-8ae5-4a51-8377-b2a9678959e5 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 200 len: 1309 microversion: 2.1 time: 0.108242 Jun 23 08:24:16.009127 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 265/516] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:15 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:16.035523 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cfd3451f-7d8e-4e4f-ac8c-c019f0fc977a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:16.043286 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cfd3451f-7d8e-4e4f-ac8c-c019f0fc977a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.315840 Jun 23 08:24:16.044136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 252/517] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:15 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:16.489097 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-dcb6455e-ffc9-4646-bc7c-cf058511c498 req-48d2fb23-c6c6-4ded-a72e-9cd7962bc073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc92fdb9-d1dd-4771-b503-766a91a813e9", "tag": "8490cc9a-79c6-4e36-b7ae-2c291e958bcf"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:16.498190 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-dcb6455e-ffc9-4646-bc7c-cf058511c498 req-48d2fb23-c6c6-4ded-a72e-9cd7962bc073 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:16.499029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-dcb6455e-ffc9-4646-bc7c-cf058511c498 req-48d2fb23-c6c6-4ded-a72e-9cd7962bc073 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:16.518415 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-dcb6455e-ffc9-4646-bc7c-cf058511c498 req-48d2fb23-c6c6-4ded-a72e-9cd7962bc073 service nova] Creating event network-changed:8490cc9a-79c6-4e36-b7ae-2c291e958bcf for instance dc92fdb9-d1dd-4771-b503-766a91a813e9 on hv-cinder-84721 Jun 23 08:24:16.529017 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7e715b36-4fc8-4460-b99e-38f16bf982ec tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:16.529440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-dcb6455e-ffc9-4646-bc7c-cf058511c498 req-48d2fb23-c6c6-4ded-a72e-9cd7962bc073 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044488 Jun 23 08:24:16.530131 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7e715b36-4fc8-4460-b99e-38f16bf982ec tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:16.530427 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 266/518] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:16.538065 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7e715b36-4fc8-4460-b99e-38f16bf982ec tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:16.538517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7e715b36-4fc8-4460-b99e-38f16bf982ec tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:16.540010 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7e715b36-4fc8-4460-b99e-38f16bf982ec tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:16.540819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7e715b36-4fc8-4460-b99e-38f16bf982ec tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:16.720813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7e715b36-4fc8-4460-b99e-38f16bf982ec tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:16.728961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7e715b36-4fc8-4460-b99e-38f16bf982ec tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.204066 Jun 23 08:24:16.729529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 253/519] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:16 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:17.027168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:17.028508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 46c73899-1dfd-4ce2-b988-681df43ef5e6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:17.030479 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:17.035706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:17.036147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:17.036929 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:17.037358 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:17.056028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] HTTP exception thrown: Instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 could not be found. Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Request method failure captured: Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 HTTP/1.1 Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCKHCl_tlzvpxQ-j5SkJjwHd4AihU4ERmVLFUYXpU-ESLalTF0vP_hDPlydfdIQAyGGVybM0O9b2uDpQPCszxhGcYLZVzVzgZWZxnX5UtQaQWi_djtUxWZ51Ek28tDbm085YO5pHweu3RF1SJRKLJu-dMGn6hNobBVJtZF6EDtOMMD4 Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: bea8f88d81c04623b66edaf1cebc2ee3 Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1211208290 Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:24:17.057840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bea8f88d81c04623b66edaf1cebc2ee3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bea8f88d81c04623b66edaf1cebc2ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bea8f88d81c04623b66edaf1cebc2ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bea8f88d81c04623b66edaf1cebc2ee3"}]}] Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesSnapshotTestJSON-1211208290 Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: bea8f88d81c04623b66edaf1cebc2ee3 Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1211208290 Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesSnapshotTestJSON-1211208290-project Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 44b66024bd78487082154441343a2161 Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesSnapshotTestJSON-1211208290-project Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 could not be found. Jun 23 08:24:17.059287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '46c73899-1dfd-4ce2-b988-681df43ef5e6'} Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 could not be found. Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:24:17.060109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 could not be found. Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 could not be found. Jun 23 08:24:17.061324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:24:17.062443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Returning 404 to user: Instance 46c73899-1dfd-4ce2-b988-681df43ef5e6 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:24:17.062443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5a60b2bb-b246-45bb-ae15-c529394390d9 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6" status: 404 len: 111 microversion: 2.1 time: 0.036902 Jun 23 08:24:17.062443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 267/520] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:17 2022] GET /compute/v2.1/servers/46c73899-1dfd-4ce2-b988-681df43ef5e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:24:17.065044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c3209c20-a23f-434a-aa90-240713bfab37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:17.066600 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c3209c20-a23f-434a-aa90-240713bfab37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:17.072587 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3209c20-a23f-434a-aa90-240713bfab37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:17.073260 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3209c20-a23f-434a-aa90-240713bfab37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:17.074345 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3209c20-a23f-434a-aa90-240713bfab37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:17.074922 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3209c20-a23f-434a-aa90-240713bfab37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:17.251411 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c3209c20-a23f-434a-aa90-240713bfab37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:17.259937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c3209c20-a23f-434a-aa90-240713bfab37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.203182 Jun 23 08:24:17.260922 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 254/521] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:17 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:17.746756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d73202b2-b731-46d1-a542-c724a70965fc tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:17.747408 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d73202b2-b731-46d1-a542-c724a70965fc tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:17.753997 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d73202b2-b731-46d1-a542-c724a70965fc tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:17.754450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d73202b2-b731-46d1-a542-c724a70965fc tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:17.755235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d73202b2-b731-46d1-a542-c724a70965fc tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:17.755730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d73202b2-b731-46d1-a542-c724a70965fc tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:17.890946 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d73202b2-b731-46d1-a542-c724a70965fc tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:17.898532 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d73202b2-b731-46d1-a542-c724a70965fc tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.156481 Jun 23 08:24:17.899118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 268/522] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:17 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:18.279527 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9990c8c2-646b-4bdf-bcce-d33b18ed077d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:18.280200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9990c8c2-646b-4bdf-bcce-d33b18ed077d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:18.288224 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9990c8c2-646b-4bdf-bcce-d33b18ed077d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:18.288653 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9990c8c2-646b-4bdf-bcce-d33b18ed077d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:18.289759 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9990c8c2-646b-4bdf-bcce-d33b18ed077d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:18.290992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9990c8c2-646b-4bdf-bcce-d33b18ed077d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:18.454928 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9990c8c2-646b-4bdf-bcce-d33b18ed077d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:18.462730 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9990c8c2-646b-4bdf-bcce-d33b18ed077d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.188733 Jun 23 08:24:18.472749 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 255/523] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:18 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:18.491081 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-c8318658-3027-48d3-ae71-396192c289eb req-0241e06c-bde8-44fa-947d-008d58ed4448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b633ac69-2692-493b-832c-15eabce9ecf0", "name": "network-vif-plugged", "status": "completed", "tag": "174a2882-7714-4c7b-bee8-c77dc51a32d1"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:18.500847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c8318658-3027-48d3-ae71-396192c289eb req-0241e06c-bde8-44fa-947d-008d58ed4448 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:18.501436 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c8318658-3027-48d3-ae71-396192c289eb req-0241e06c-bde8-44fa-947d-008d58ed4448 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:18.513873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-c8318658-3027-48d3-ae71-396192c289eb req-0241e06c-bde8-44fa-947d-008d58ed4448 service nova] Creating event network-vif-plugged:174a2882-7714-4c7b-bee8-c77dc51a32d1 for instance b633ac69-2692-493b-832c-15eabce9ecf0 on hv-cinder-84721 Jun 23 08:24:18.518620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-c8318658-3027-48d3-ae71-396192c289eb req-0241e06c-bde8-44fa-947d-008d58ed4448 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031323 Jun 23 08:24:18.519235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 269/524] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:18.915868 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8246a8f6-6c13-48e5-8063-502d2d033132 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:18.916476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8246a8f6-6c13-48e5-8063-502d2d033132 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:18.922963 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8246a8f6-6c13-48e5-8063-502d2d033132 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:18.923486 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8246a8f6-6c13-48e5-8063-502d2d033132 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:18.924246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8246a8f6-6c13-48e5-8063-502d2d033132 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:18.924675 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8246a8f6-6c13-48e5-8063-502d2d033132 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:19.073610 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8246a8f6-6c13-48e5-8063-502d2d033132 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:19.081472 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8246a8f6-6c13-48e5-8063-502d2d033132 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.169627 Jun 23 08:24:19.082012 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 256/525] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:18 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:19.481231 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-51415c5d-b7bc-4d9a-a581-70b4afbba3dc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:19.481939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-51415c5d-b7bc-4d9a-a581-70b4afbba3dc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:19.489048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51415c5d-b7bc-4d9a-a581-70b4afbba3dc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:19.489499 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51415c5d-b7bc-4d9a-a581-70b4afbba3dc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:19.490319 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51415c5d-b7bc-4d9a-a581-70b4afbba3dc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:19.490750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51415c5d-b7bc-4d9a-a581-70b4afbba3dc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:19.627880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-51415c5d-b7bc-4d9a-a581-70b4afbba3dc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:19.636082 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-51415c5d-b7bc-4d9a-a581-70b4afbba3dc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.159943 Jun 23 08:24:19.636649 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 270/526] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:19 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:20.102640 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-951c422f-9a13-42cd-b6bc-19686d30ab64 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:20.103585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-951c422f-9a13-42cd-b6bc-19686d30ab64 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:20.115127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-951c422f-9a13-42cd-b6bc-19686d30ab64 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:20.115917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-951c422f-9a13-42cd-b6bc-19686d30ab64 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:20.117161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-951c422f-9a13-42cd-b6bc-19686d30ab64 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:20.117876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-951c422f-9a13-42cd-b6bc-19686d30ab64 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:20.247317 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-951c422f-9a13-42cd-b6bc-19686d30ab64 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:20.254863 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-951c422f-9a13-42cd-b6bc-19686d30ab64 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.158717 Jun 23 08:24:20.255714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 257/527] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:20 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:20.655491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7e9ab690-3164-4102-a581-9c80718cccba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:20.656441 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7e9ab690-3164-4102-a581-9c80718cccba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:20.665349 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7e9ab690-3164-4102-a581-9c80718cccba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:20.665934 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7e9ab690-3164-4102-a581-9c80718cccba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:20.667127 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7e9ab690-3164-4102-a581-9c80718cccba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:20.667728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7e9ab690-3164-4102-a581-9c80718cccba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:20.804937 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7e9ab690-3164-4102-a581-9c80718cccba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:20.814387 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7e9ab690-3164-4102-a581-9c80718cccba tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.164343 Jun 23 08:24:20.814956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 271/528] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:20 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:21.276965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a12755af-52b5-4f4a-8a67-047520fcbf95 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:21.279046 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a12755af-52b5-4f4a-8a67-047520fcbf95 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:21.290396 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a12755af-52b5-4f4a-8a67-047520fcbf95 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:21.291337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a12755af-52b5-4f4a-8a67-047520fcbf95 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:21.292141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a12755af-52b5-4f4a-8a67-047520fcbf95 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:21.292568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a12755af-52b5-4f4a-8a67-047520fcbf95 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:21.425800 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a12755af-52b5-4f4a-8a67-047520fcbf95 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:21.434016 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a12755af-52b5-4f4a-8a67-047520fcbf95 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.164351 Jun 23 08:24:21.434630 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 258/529] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:21 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:21.836791 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c756103a-3e8b-4d6f-9ce7-86a932b0a53e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:21.837871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c756103a-3e8b-4d6f-9ce7-86a932b0a53e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:21.848940 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c756103a-3e8b-4d6f-9ce7-86a932b0a53e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:21.849569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c756103a-3e8b-4d6f-9ce7-86a932b0a53e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:21.850774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c756103a-3e8b-4d6f-9ce7-86a932b0a53e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:21.851574 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c756103a-3e8b-4d6f-9ce7-86a932b0a53e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:21.988155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c756103a-3e8b-4d6f-9ce7-86a932b0a53e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:21.999871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c756103a-3e8b-4d6f-9ce7-86a932b0a53e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.169822 Jun 23 08:24:22.000730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 272/530] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:21 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:22.451676 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f82c6381-9043-420a-a195-08f0616f867a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:22.452254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f82c6381-9043-420a-a195-08f0616f867a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:22.460138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f82c6381-9043-420a-a195-08f0616f867a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:22.460591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f82c6381-9043-420a-a195-08f0616f867a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:22.461340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f82c6381-9043-420a-a195-08f0616f867a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:22.461766 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f82c6381-9043-420a-a195-08f0616f867a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:22.599871 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f82c6381-9043-420a-a195-08f0616f867a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:22.607798 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f82c6381-9043-420a-a195-08f0616f867a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.160478 Jun 23 08:24:22.608349 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 259/531] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:22 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:23.024912 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-84db77b4-b767-473d-bc88-ae77dd57029d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:23.025805 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-84db77b4-b767-473d-bc88-ae77dd57029d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:23.033012 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-84db77b4-b767-473d-bc88-ae77dd57029d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:23.033457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-84db77b4-b767-473d-bc88-ae77dd57029d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:23.034184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-84db77b4-b767-473d-bc88-ae77dd57029d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:23.034646 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-84db77b4-b767-473d-bc88-ae77dd57029d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:23.167550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-84db77b4-b767-473d-bc88-ae77dd57029d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:23.175038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-84db77b4-b767-473d-bc88-ae77dd57029d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.156781 Jun 23 08:24:23.175650 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 273/532] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:23 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:23.625539 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-59e627f7-fdda-4256-b912-fd3e42ab5222 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:23.626122 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-59e627f7-fdda-4256-b912-fd3e42ab5222 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:23.633207 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-59e627f7-fdda-4256-b912-fd3e42ab5222 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:23.633650 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-59e627f7-fdda-4256-b912-fd3e42ab5222 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:23.634423 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-59e627f7-fdda-4256-b912-fd3e42ab5222 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:23.634888 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-59e627f7-fdda-4256-b912-fd3e42ab5222 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:23.767954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-59e627f7-fdda-4256-b912-fd3e42ab5222 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:23.776799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-59e627f7-fdda-4256-b912-fd3e42ab5222 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.155697 Jun 23 08:24:23.777378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 260/533] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:23 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:24.195536 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-29feb4f9-5a2d-47bf-b6d9-f8bedf2b7421 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:24.196233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-29feb4f9-5a2d-47bf-b6d9-f8bedf2b7421 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:24.203641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-29feb4f9-5a2d-47bf-b6d9-f8bedf2b7421 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:24.204085 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-29feb4f9-5a2d-47bf-b6d9-f8bedf2b7421 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:24.204843 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-29feb4f9-5a2d-47bf-b6d9-f8bedf2b7421 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:24.205271 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-29feb4f9-5a2d-47bf-b6d9-f8bedf2b7421 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:24.355636 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-29feb4f9-5a2d-47bf-b6d9-f8bedf2b7421 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:24.364521 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-29feb4f9-5a2d-47bf-b6d9-f8bedf2b7421 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.175447 Jun 23 08:24:24.365335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 274/534] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:24 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:24.793985 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9f2667dc-5b2c-4572-8c9b-9dedba5ef669 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:24.794594 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9f2667dc-5b2c-4572-8c9b-9dedba5ef669 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:24.800738 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f2667dc-5b2c-4572-8c9b-9dedba5ef669 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:24.801381 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f2667dc-5b2c-4572-8c9b-9dedba5ef669 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:24.802139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f2667dc-5b2c-4572-8c9b-9dedba5ef669 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:24.802569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f2667dc-5b2c-4572-8c9b-9dedba5ef669 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:24.939802 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9f2667dc-5b2c-4572-8c9b-9dedba5ef669 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:24.947913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9f2667dc-5b2c-4572-8c9b-9dedba5ef669 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.157988 Jun 23 08:24:24.948488 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 261/535] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:24 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:25.381940 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8affde1f-ec38-4fad-a2e9-247cd6021e7a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:25.382654 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8affde1f-ec38-4fad-a2e9-247cd6021e7a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:25.389648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8affde1f-ec38-4fad-a2e9-247cd6021e7a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:25.390132 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8affde1f-ec38-4fad-a2e9-247cd6021e7a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:25.390863 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8affde1f-ec38-4fad-a2e9-247cd6021e7a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:25.391320 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8affde1f-ec38-4fad-a2e9-247cd6021e7a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:25.572951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8affde1f-ec38-4fad-a2e9-247cd6021e7a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:25.580520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8affde1f-ec38-4fad-a2e9-247cd6021e7a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.202383 Jun 23 08:24:25.581088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 275/536] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:25 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:25.965942 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8403c35b-4f91-45b5-93ec-a9ce3f3a051a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:25.966537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8403c35b-4f91-45b5-93ec-a9ce3f3a051a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:25.974159 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8403c35b-4f91-45b5-93ec-a9ce3f3a051a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:25.974606 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8403c35b-4f91-45b5-93ec-a9ce3f3a051a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:25.975445 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8403c35b-4f91-45b5-93ec-a9ce3f3a051a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:25.975879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8403c35b-4f91-45b5-93ec-a9ce3f3a051a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:26.116864 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8403c35b-4f91-45b5-93ec-a9ce3f3a051a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:26.125251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8403c35b-4f91-45b5-93ec-a9ce3f3a051a tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.163654 Jun 23 08:24:26.125813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 262/537] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:25 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:26.602155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4cd8e7a2-b02f-45b4-b725-9de9745ad64f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:26.603136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4cd8e7a2-b02f-45b4-b725-9de9745ad64f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:26.614108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cd8e7a2-b02f-45b4-b725-9de9745ad64f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:26.614842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cd8e7a2-b02f-45b4-b725-9de9745ad64f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:26.616134 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cd8e7a2-b02f-45b4-b725-9de9745ad64f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:26.616842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cd8e7a2-b02f-45b4-b725-9de9745ad64f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:26.752514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4cd8e7a2-b02f-45b4-b725-9de9745ad64f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:26.760088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4cd8e7a2-b02f-45b4-b725-9de9745ad64f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.164571 Jun 23 08:24:26.760671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 276/538] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:26 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:27.141914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8115e779-cfed-43ba-a571-dd55de5e3aed tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:27.142451 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8115e779-cfed-43ba-a571-dd55de5e3aed tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:27.149138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8115e779-cfed-43ba-a571-dd55de5e3aed tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:27.149572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8115e779-cfed-43ba-a571-dd55de5e3aed tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:27.150505 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8115e779-cfed-43ba-a571-dd55de5e3aed tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:27.151093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8115e779-cfed-43ba-a571-dd55de5e3aed tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:27.285237 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8115e779-cfed-43ba-a571-dd55de5e3aed tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:27.293410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8115e779-cfed-43ba-a571-dd55de5e3aed tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.155421 Jun 23 08:24:27.293974 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 263/539] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:27 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:27.781661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-75001c6d-d13f-44a3-a62d-0636c2a94fc1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:27.782428 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-75001c6d-d13f-44a3-a62d-0636c2a94fc1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:27.792902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-75001c6d-d13f-44a3-a62d-0636c2a94fc1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:27.793352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-75001c6d-d13f-44a3-a62d-0636c2a94fc1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:27.794144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-75001c6d-d13f-44a3-a62d-0636c2a94fc1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:27.794577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-75001c6d-d13f-44a3-a62d-0636c2a94fc1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:27.931944 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-75001c6d-d13f-44a3-a62d-0636c2a94fc1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:27.935789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:27.940235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-75001c6d-d13f-44a3-a62d-0636c2a94fc1 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.165221 Jun 23 08:24:27.945804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 277/540] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:27 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:28.311599 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c8562983-ddf7-4900-b09e-639c96b7cfa4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:28.312336 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c8562983-ddf7-4900-b09e-639c96b7cfa4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:28.319361 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c8562983-ddf7-4900-b09e-639c96b7cfa4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:28.319810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c8562983-ddf7-4900-b09e-639c96b7cfa4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:28.320564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c8562983-ddf7-4900-b09e-639c96b7cfa4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:28.320992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c8562983-ddf7-4900-b09e-639c96b7cfa4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:28.445449 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b8f93807-ad5e-435e-bd6c-a37cf8e5de1f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:28.445942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b8f93807-ad5e-435e-bd6c-a37cf8e5de1f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:28.451620 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c8562983-ddf7-4900-b09e-639c96b7cfa4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:28.453332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b8f93807-ad5e-435e-bd6c-a37cf8e5de1f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:28.453757 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b8f93807-ad5e-435e-bd6c-a37cf8e5de1f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:28.454510 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b8f93807-ad5e-435e-bd6c-a37cf8e5de1f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:28.454969 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b8f93807-ad5e-435e-bd6c-a37cf8e5de1f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:28.459161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c8562983-ddf7-4900-b09e-639c96b7cfa4 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.152184 Jun 23 08:24:28.459787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 264/541] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:28 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:28.479039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b8f93807-ad5e-435e-bd6c-a37cf8e5de1f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/ips" status: 200 len: 152 microversion: 2.20 time: 0.037794 Jun 23 08:24:28.479603 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 278/542] 10.222.0.33 () {60 vars in 1288 bytes} [Thu Jun 23 08:24:28 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 08:24:28.961718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-33c7ad56-ed68-46e2-9fbb-d979b6840a1b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:28.962844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-33c7ad56-ed68-46e2-9fbb-d979b6840a1b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:28.969624 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-33c7ad56-ed68-46e2-9fbb-d979b6840a1b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:28.970390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-33c7ad56-ed68-46e2-9fbb-d979b6840a1b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:28.971310 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-33c7ad56-ed68-46e2-9fbb-d979b6840a1b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:28.971825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-33c7ad56-ed68-46e2-9fbb-d979b6840a1b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:29.247762 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-33c7ad56-ed68-46e2-9fbb-d979b6840a1b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:29.256288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-33c7ad56-ed68-46e2-9fbb-d979b6840a1b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.300020 Jun 23 08:24:29.256855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 265/543] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:28 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:29.480125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-48641406-710d-4a36-8b91-bf9eb706d6c7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:29.480730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-48641406-710d-4a36-8b91-bf9eb706d6c7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:29.489019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-48641406-710d-4a36-8b91-bf9eb706d6c7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:29.489390 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-48641406-710d-4a36-8b91-bf9eb706d6c7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:29.490160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-48641406-710d-4a36-8b91-bf9eb706d6c7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:29.490606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-48641406-710d-4a36-8b91-bf9eb706d6c7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:29.637256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-48641406-710d-4a36-8b91-bf9eb706d6c7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:29.644915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-48641406-710d-4a36-8b91-bf9eb706d6c7 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.172220 Jun 23 08:24:29.645482 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 279/544] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:29 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:30.111430 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1425261823", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "networks": [{"uuid": "e8b230c3-b97b-4159-872a-2abe9ad01e6c"}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:30.169053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] validate_networks() for [('e8b230c3-b97b-4159-872a-2abe9ad01e6c', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:24:30.274428 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3be90406-559a-4a96-857b-21d313a7e200 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:30.274966 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3be90406-559a-4a96-857b-21d313a7e200 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:30.281691 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3be90406-559a-4a96-857b-21d313a7e200 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:30.282143 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3be90406-559a-4a96-857b-21d313a7e200 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:30.282930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3be90406-559a-4a96-857b-21d313a7e200 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:30.283384 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3be90406-559a-4a96-857b-21d313a7e200 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:30.442045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3be90406-559a-4a96-857b-21d313a7e200 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:30.456010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3be90406-559a-4a96-857b-21d313a7e200 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.185024 Jun 23 08:24:30.459251 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 280/545] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:30 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:30.561879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:24:30.562293 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:24:30.562760 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:24:30.563335 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:24:30.563743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:24:30.572845 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:30.573428 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:30.574217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:30.574646 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:30.591473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Getting quotas for project bea8f88d81c04623b66edaf1cebc2ee3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:24:30.595673 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Getting quotas for user 44b66024bd78487082154441343a2161 and project bea8f88d81c04623b66edaf1cebc2ee3. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:24:30.606881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:24:30.609240 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:24:30.620495 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=82 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:30.656116 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4a4a0526-126d-4979-b19a-22d31ea0e6cf tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547748 Jun 23 08:24:30.656303 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 266/546] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:24:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:24:30.666233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-affa6e4d-77ee-4a3f-b6fb-3795118d0558 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:30.667083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-affa6e4d-77ee-4a3f-b6fb-3795118d0558 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:30.670229 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9119fa35-30a6-46af-ad4f-51ef4831e082 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:30.670982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9119fa35-30a6-46af-ad4f-51ef4831e082 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:30.686076 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9119fa35-30a6-46af-ad4f-51ef4831e082 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:30.686637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9119fa35-30a6-46af-ad4f-51ef4831e082 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:30.687768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9119fa35-30a6-46af-ad4f-51ef4831e082 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:30.692343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9119fa35-30a6-46af-ad4f-51ef4831e082 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:30.729680 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-affa6e4d-77ee-4a3f-b6fb-3795118d0558 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:30.740055 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-affa6e4d-77ee-4a3f-b6fb-3795118d0558 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1219 microversion: 2.1 time: 0.076652 Jun 23 08:24:30.741025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 267/547] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:30 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:30.884152 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9119fa35-30a6-46af-ad4f-51ef4831e082 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:30.893864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9119fa35-30a6-46af-ad4f-51ef4831e082 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1315 microversion: 2.1 time: 0.231025 Jun 23 08:24:30.901108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 281/548] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:30 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:31.463012 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7796802e-b553-48ad-b732-5f71d7905608 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:31.463924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7796802e-b553-48ad-b732-5f71d7905608 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:31.471419 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7796802e-b553-48ad-b732-5f71d7905608 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.471891 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7796802e-b553-48ad-b732-5f71d7905608 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.472666 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7796802e-b553-48ad-b732-5f71d7905608 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.473097 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7796802e-b553-48ad-b732-5f71d7905608 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.473239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e528d8ae-21e4-4b80-8a78-d36589e5c3f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:31.473736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e528d8ae-21e4-4b80-8a78-d36589e5c3f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:31.480285 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e528d8ae-21e4-4b80-8a78-d36589e5c3f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.480728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e528d8ae-21e4-4b80-8a78-d36589e5c3f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.481500 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e528d8ae-21e4-4b80-8a78-d36589e5c3f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.481935 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e528d8ae-21e4-4b80-8a78-d36589e5c3f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.497566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-7796802e-b553-48ad-b732-5f71d7905608 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lazy-loading 'flavor' on Instance uuid a62a72a3-1376-4284-94a0-d57fbe81f1b9 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:24:31.501451 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:31.630446 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e528d8ae-21e4-4b80-8a78-d36589e5c3f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:31.638287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e528d8ae-21e4-4b80-8a78-d36589e5c3f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.169048 Jun 23 08:24:31.638883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 282/549] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:31 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:31.759190 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bc299e0d-f3d8-4190-975c-99ff9a658604 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:31.760241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bc299e0d-f3d8-4190-975c-99ff9a658604 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:31.767404 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc299e0d-f3d8-4190-975c-99ff9a658604 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.768220 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc299e0d-f3d8-4190-975c-99ff9a658604 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.769037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc299e0d-f3d8-4190-975c-99ff9a658604 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.769443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc299e0d-f3d8-4190-975c-99ff9a658604 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.803137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7796802e-b553-48ad-b732-5f71d7905608 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/action" status: 202 len: 0 microversion: 2.20 time: 0.343905 Jun 23 08:24:31.805437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 268/550] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 23 08:24:31 2022] POST /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:24:31.816230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:31.816230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:31.823562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.824017 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.824780 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.825378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.852416 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bc299e0d-f3d8-4190-975c-99ff9a658604 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:31.866365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bc299e0d-f3d8-4190-975c-99ff9a658604 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1271 microversion: 2.1 time: 0.112027 Jun 23 08:24:31.866953 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 283/551] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:31 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:31.911353 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-89da02ef-6242-4d3a-a324-8542d4ff1a75 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:31.912125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-89da02ef-6242-4d3a-a324-8542d4ff1a75 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:31.918538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89da02ef-6242-4d3a-a324-8542d4ff1a75 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.918987 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89da02ef-6242-4d3a-a324-8542d4ff1a75 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.919950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89da02ef-6242-4d3a-a324-8542d4ff1a75 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:31.920391 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89da02ef-6242-4d3a-a324-8542d4ff1a75 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:31.978115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:31.986421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:31.987954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:31.989103 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4a15a9ad-d28b-4403-a26b-39e934a98066 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.179098 Jun 23 08:24:31.999267 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 269/552] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:31 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:31.999267 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-40b3b4aa-d3c6-48d8-8522-ec87f7b4289e req-0fe844a6-7dac-42f5-9720-61bbeabb8701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc92fdb9-d1dd-4771-b503-766a91a813e9", "name": "network-vif-plugged", "status": "completed", "tag": "8490cc9a-79c6-4e36-b7ae-2c291e958bcf"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:32.005261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-40b3b4aa-d3c6-48d8-8522-ec87f7b4289e req-0fe844a6-7dac-42f5-9720-61bbeabb8701 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.006004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-40b3b4aa-d3c6-48d8-8522-ec87f7b4289e req-0fe844a6-7dac-42f5-9720-61bbeabb8701 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.019006 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-40b3b4aa-d3c6-48d8-8522-ec87f7b4289e req-0fe844a6-7dac-42f5-9720-61bbeabb8701 service nova] Creating event network-vif-plugged:8490cc9a-79c6-4e36-b7ae-2c291e958bcf for instance dc92fdb9-d1dd-4771-b503-766a91a813e9 on hv-cinder-84721 Jun 23 08:24:32.024587 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-40b3b4aa-d3c6-48d8-8522-ec87f7b4289e req-0fe844a6-7dac-42f5-9720-61bbeabb8701 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032711 Jun 23 08:24:32.025580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 270/553] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:32.067494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-89da02ef-6242-4d3a-a324-8542d4ff1a75 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:32.075884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-89da02ef-6242-4d3a-a324-8542d4ff1a75 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1464 microversion: 2.1 time: 0.168226 Jun 23 08:24:32.076517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 284/554] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:31 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:32.116566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-27265e75-d0ee-4547-af48-4bbd28427916 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:32.117146 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-27265e75-d0ee-4547-af48-4bbd28427916 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:32.124057 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-27265e75-d0ee-4547-af48-4bbd28427916 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.124506 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-27265e75-d0ee-4547-af48-4bbd28427916 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.125271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-27265e75-d0ee-4547-af48-4bbd28427916 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.125703 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-27265e75-d0ee-4547-af48-4bbd28427916 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.157049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-27265e75-d0ee-4547-af48-4bbd28427916 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:24:32.247439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-27265e75-d0ee-4547-af48-4bbd28427916 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 204 len: 0 microversion: 2.1 time: 0.134789 Jun 23 08:24:32.248014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 271/555] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:24:32 2022] DELETE /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:24:32.256216 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c506319e-c143-4b1a-b809-145c34e81871 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:32.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c506319e-c143-4b1a-b809-145c34e81871 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:32.263094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c506319e-c143-4b1a-b809-145c34e81871 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.263569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c506319e-c143-4b1a-b809-145c34e81871 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.264352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c506319e-c143-4b1a-b809-145c34e81871 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.264764 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c506319e-c143-4b1a-b809-145c34e81871 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.407474 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c506319e-c143-4b1a-b809-145c34e81871 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:32.418106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c506319e-c143-4b1a-b809-145c34e81871 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1470 microversion: 2.1 time: 0.165683 Jun 23 08:24:32.418647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 285/556] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:32 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:32.655514 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-63ec6612-069f-4a16-a1e2-ed2d27287059 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:32.656217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-63ec6612-069f-4a16-a1e2-ed2d27287059 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:32.663014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-63ec6612-069f-4a16-a1e2-ed2d27287059 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.663499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-63ec6612-069f-4a16-a1e2-ed2d27287059 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.664253 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-63ec6612-069f-4a16-a1e2-ed2d27287059 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.664682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-63ec6612-069f-4a16-a1e2-ed2d27287059 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.817569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-63ec6612-069f-4a16-a1e2-ed2d27287059 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:32.829954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-63ec6612-069f-4a16-a1e2-ed2d27287059 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.178747 Jun 23 08:24:32.830792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 272/557] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:32 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:32.884111 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-efd74ef0-87e3-4118-be80-83240fb78407 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:32.884717 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-efd74ef0-87e3-4118-be80-83240fb78407 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:32.892172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-efd74ef0-87e3-4118-be80-83240fb78407 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.892619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-efd74ef0-87e3-4118-be80-83240fb78407 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.893397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-efd74ef0-87e3-4118-be80-83240fb78407 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:32.893827 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-efd74ef0-87e3-4118-be80-83240fb78407 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:32.958932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-efd74ef0-87e3-4118-be80-83240fb78407 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:32.967712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-efd74ef0-87e3-4118-be80-83240fb78407 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1271 microversion: 2.1 time: 0.087296 Jun 23 08:24:32.968309 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 286/558] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:32 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:33.009217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:33.009810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:33.016305 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:33.016744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:33.017489 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:33.017914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:33.164561 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:33.172999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:33.174680 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:33.175839 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7fc95774-b93b-4f65-aee9-0eb250d54a93 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.170606 Jun 23 08:24:33.176380 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 273/559] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:33 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:33.437336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ad3e32a0-6a22-4ebe-a66b-5e0161e0e041 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:33.437824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ad3e32a0-6a22-4ebe-a66b-5e0161e0e041 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:33.444410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad3e32a0-6a22-4ebe-a66b-5e0161e0e041 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:33.444917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad3e32a0-6a22-4ebe-a66b-5e0161e0e041 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:33.445608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad3e32a0-6a22-4ebe-a66b-5e0161e0e041 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:33.446039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad3e32a0-6a22-4ebe-a66b-5e0161e0e041 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:33.586635 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ad3e32a0-6a22-4ebe-a66b-5e0161e0e041 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:33.595530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ad3e32a0-6a22-4ebe-a66b-5e0161e0e041 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1470 microversion: 2.1 time: 0.162256 Jun 23 08:24:33.596102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 287/560] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:33 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:33.853170 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bc04756c-8b6f-4797-af80-e288f033588d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:33.854181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bc04756c-8b6f-4797-af80-e288f033588d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:33.862349 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bc04756c-8b6f-4797-af80-e288f033588d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:33.862817 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bc04756c-8b6f-4797-af80-e288f033588d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:33.863596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bc04756c-8b6f-4797-af80-e288f033588d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:33.864026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bc04756c-8b6f-4797-af80-e288f033588d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:33.987027 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-757970b0-e649-47d5-9c9d-c933e5852953 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:33.988168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-757970b0-e649-47d5-9c9d-c933e5852953 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:33.995586 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-757970b0-e649-47d5-9c9d-c933e5852953 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:33.997236 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-757970b0-e649-47d5-9c9d-c933e5852953 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:33.998297 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-757970b0-e649-47d5-9c9d-c933e5852953 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:33.998736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-757970b0-e649-47d5-9c9d-c933e5852953 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:33.999552 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bc04756c-8b6f-4797-af80-e288f033588d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:34.008120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bc04756c-8b6f-4797-af80-e288f033588d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.161223 Jun 23 08:24:34.008939 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 274/561] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:33 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:34.062235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-757970b0-e649-47d5-9c9d-c933e5852953 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:34.070171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-757970b0-e649-47d5-9c9d-c933e5852953 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1271 microversion: 2.1 time: 0.089750 Jun 23 08:24:34.070707 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 288/562] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:33 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:34.194273 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:34.194812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:34.201180 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:34.201615 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:34.202703 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:34.203145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:34.341379 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:34.349629 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:34.351120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:34.352296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8522a275-936d-44cc-8792-00fcbc0a41e7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.162186 Jun 23 08:24:34.352857 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 275/563] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:34 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:34.619241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8588d352-33da-455a-8e51-213cbb8fc0a2 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:34.620326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8588d352-33da-455a-8e51-213cbb8fc0a2 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:34.630726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8588d352-33da-455a-8e51-213cbb8fc0a2 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:34.632045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8588d352-33da-455a-8e51-213cbb8fc0a2 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:34.633285 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8588d352-33da-455a-8e51-213cbb8fc0a2 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:34.634002 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8588d352-33da-455a-8e51-213cbb8fc0a2 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:34.769312 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8588d352-33da-455a-8e51-213cbb8fc0a2 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:34.777389 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8588d352-33da-455a-8e51-213cbb8fc0a2 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1470 microversion: 2.1 time: 0.164562 Jun 23 08:24:34.777952 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 289/564] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:34 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:35.025566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8a8349b7-2778-4c8b-ba92-57387a4508c9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:35.026106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8a8349b7-2778-4c8b-ba92-57387a4508c9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:35.032841 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8a8349b7-2778-4c8b-ba92-57387a4508c9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:35.033280 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8a8349b7-2778-4c8b-ba92-57387a4508c9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:35.034026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8a8349b7-2778-4c8b-ba92-57387a4508c9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:35.034567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8a8349b7-2778-4c8b-ba92-57387a4508c9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:35.087125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5d260bf9-a15b-4a1e-938e-ddba6201d2a2 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:35.087804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5d260bf9-a15b-4a1e-938e-ddba6201d2a2 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:35.094967 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5d260bf9-a15b-4a1e-938e-ddba6201d2a2 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:35.095446 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5d260bf9-a15b-4a1e-938e-ddba6201d2a2 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:35.096281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5d260bf9-a15b-4a1e-938e-ddba6201d2a2 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:35.096710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5d260bf9-a15b-4a1e-938e-ddba6201d2a2 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:35.167501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5d260bf9-a15b-4a1e-938e-ddba6201d2a2 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:35.175149 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5d260bf9-a15b-4a1e-938e-ddba6201d2a2 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1289 microversion: 2.1 time: 0.091908 Jun 23 08:24:35.175756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 290/565] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:35 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:35.176564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8a8349b7-2778-4c8b-ba92-57387a4508c9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:35.185172 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8a8349b7-2778-4c8b-ba92-57387a4508c9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.163561 Jun 23 08:24:35.185734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 276/566] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:35 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:35.371336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:35.371938 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:35.378572 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:35.379011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:35.379796 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:35.380219 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:35.513908 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:35.522589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:35.524133 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:35.525311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e8490371-f105-493b-b60f-2a0130d9d7d9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.158283 Jun 23 08:24:35.525884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 291/567] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:35 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:35.795196 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1e61d5e3-28b1-4e58-9461-88269928287b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:35.796210 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1e61d5e3-28b1-4e58-9461-88269928287b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:35.802810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e61d5e3-28b1-4e58-9461-88269928287b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:35.803265 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e61d5e3-28b1-4e58-9461-88269928287b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:35.804027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e61d5e3-28b1-4e58-9461-88269928287b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:35.804475 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e61d5e3-28b1-4e58-9461-88269928287b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:36.086569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1e61d5e3-28b1-4e58-9461-88269928287b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:36.095786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1e61d5e3-28b1-4e58-9461-88269928287b tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1470 microversion: 2.1 time: 0.304544 Jun 23 08:24:36.096346 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 277/568] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:35 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1470 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:36.192704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6f439f35-2cb3-427b-bf08-9be07b7959df tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:36.193401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6f439f35-2cb3-427b-bf08-9be07b7959df tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:36.201183 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f439f35-2cb3-427b-bf08-9be07b7959df tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:36.201561 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f439f35-2cb3-427b-bf08-9be07b7959df tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:36.202336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f439f35-2cb3-427b-bf08-9be07b7959df tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:36.202684 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-693fa3d1-1491-494d-a806-4a2a14ecd727 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:36.202855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f439f35-2cb3-427b-bf08-9be07b7959df tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:36.203489 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-693fa3d1-1491-494d-a806-4a2a14ecd727 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:36.210811 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-693fa3d1-1491-494d-a806-4a2a14ecd727 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:36.211457 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-693fa3d1-1491-494d-a806-4a2a14ecd727 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:36.212337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-693fa3d1-1491-494d-a806-4a2a14ecd727 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:36.212876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-693fa3d1-1491-494d-a806-4a2a14ecd727 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:36.272235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6f439f35-2cb3-427b-bf08-9be07b7959df tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:36.281692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6f439f35-2cb3-427b-bf08-9be07b7959df tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1277 microversion: 2.1 time: 0.092829 Jun 23 08:24:36.282296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 292/569] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:36 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:36.550886 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:36.551899 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:36.560096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:36.560839 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:36.561825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:36.562461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:36.720068 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:36.729400 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:36.731419 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:36.733081 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-976fc4a7-bb1c-4136-9bb1-01119ffc5424 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.186975 Jun 23 08:24:36.734290 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 293/570] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:36 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:36.748515 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-b1d6bf9c-4b8e-494d-98aa-d40ec4cb2a52 req-c6653875-e05c-4772-a747-128d6f3813cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b633ac69-2692-493b-832c-15eabce9ecf0", "name": "network-vif-deleted", "tag": "174a2882-7714-4c7b-bee8-c77dc51a32d1"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:36.754113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-693fa3d1-1491-494d-a806-4a2a14ecd727 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:36.759287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-b1d6bf9c-4b8e-494d-98aa-d40ec4cb2a52 req-c6653875-e05c-4772-a747-128d6f3813cd service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:36.759867 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-b1d6bf9c-4b8e-494d-98aa-d40ec4cb2a52 req-c6653875-e05c-4772-a747-128d6f3813cd service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:36.763115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-693fa3d1-1491-494d-a806-4a2a14ecd727 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1366 microversion: 2.1 time: 0.564702 Jun 23 08:24:36.764073 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 278/571] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:36 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:36.781454 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-b1d6bf9c-4b8e-494d-98aa-d40ec4cb2a52 req-c6653875-e05c-4772-a747-128d6f3813cd service nova] Creating event network-vif-deleted:174a2882-7714-4c7b-bee8-c77dc51a32d1 for instance b633ac69-2692-493b-832c-15eabce9ecf0 on hv-cinder-84721 Jun 23 08:24:36.788410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-b1d6bf9c-4b8e-494d-98aa-d40ec4cb2a52 req-c6653875-e05c-4772-a747-128d6f3813cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046118 Jun 23 08:24:36.789197 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 294/572] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:37.114743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ae125285-4296-4903-98e3-4f69beb62cf0 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:37.116075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ae125285-4296-4903-98e3-4f69beb62cf0 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:37.127201 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae125285-4296-4903-98e3-4f69beb62cf0 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.127679 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae125285-4296-4903-98e3-4f69beb62cf0 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.128476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae125285-4296-4903-98e3-4f69beb62cf0 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.128902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae125285-4296-4903-98e3-4f69beb62cf0 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.196233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ae125285-4296-4903-98e3-4f69beb62cf0 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:37.205515 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ae125285-4296-4903-98e3-4f69beb62cf0 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1300 microversion: 2.1 time: 0.095851 Jun 23 08:24:37.206187 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 279/573] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:37 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:37.300953 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c5b6b5ea-671f-44a5-a4e6-5fbea600bbc6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:37.301511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c5b6b5ea-671f-44a5-a4e6-5fbea600bbc6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:37.308475 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5b6b5ea-671f-44a5-a4e6-5fbea600bbc6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.308961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5b6b5ea-671f-44a5-a4e6-5fbea600bbc6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.309929 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5b6b5ea-671f-44a5-a4e6-5fbea600bbc6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.310374 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5b6b5ea-671f-44a5-a4e6-5fbea600bbc6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.332118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:37.451357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c5b6b5ea-671f-44a5-a4e6-5fbea600bbc6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:37.463544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c5b6b5ea-671f-44a5-a4e6-5fbea600bbc6 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.166568 Jun 23 08:24:37.464733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 295/574] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:37 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:37.752498 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:37.753096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:37.759533 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.759972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.760732 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.761158 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.780707 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b60b4419-c16e-437a-868b-923fc5e6fe0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:37.781418 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b60b4419-c16e-437a-868b-923fc5e6fe0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:37.787922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b60b4419-c16e-437a-868b-923fc5e6fe0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.788755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b60b4419-c16e-437a-868b-923fc5e6fe0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.789618 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b60b4419-c16e-437a-868b-923fc5e6fe0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.790261 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b60b4419-c16e-437a-868b-923fc5e6fe0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.940525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b60b4419-c16e-437a-868b-923fc5e6fe0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:37.948653 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b60b4419-c16e-437a-868b-923fc5e6fe0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1556 microversion: 2.1 time: 0.171926 Jun 23 08:24:37.949287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 296/575] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:37 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:24:37.970088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-923c9238-692c-4db2-a9a0-b03e06083fb0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:37.970654 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-923c9238-692c-4db2-a9a0-b03e06083fb0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:37.976879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-923c9238-692c-4db2-a9a0-b03e06083fb0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.977386 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-923c9238-692c-4db2-a9a0-b03e06083fb0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:37.978220 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-923c9238-692c-4db2-a9a0-b03e06083fb0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:37.978699 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-923c9238-692c-4db2-a9a0-b03e06083fb0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:38.020205 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:38.028395 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:38.029877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:38.031035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1925b622-26a7-40d9-a1e1-bce3cb29e4d5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.282809 Jun 23 08:24:38.031843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 280/576] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:37 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:38.060577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-923c9238-692c-4db2-a9a0-b03e06083fb0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094410 Jun 23 08:24:38.061387 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 297/577] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 08:24:37 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:38.222960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:38.224281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:38.231829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:38.232344 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:38.233288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:38.233714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:38.272999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:38.273463 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:38.274108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lazy-loading 'fault' on Instance uuid b633ac69-2692-493b-832c-15eabce9ecf0 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:24:38.327110 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578195adbe574c67a6de17a17513f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf86466e66274193b5c2b0fdf69884b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:38.337845 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-79cf137d-8b98-4dd8-b8b5-b6d1d90a6520 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 200 len: 1305 microversion: 2.1 time: 0.119180 Jun 23 08:24:38.338959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 281/578] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:38 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:38.480534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-589550c1-28e1-4e06-86cb-4e824650a773 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:38.481954 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-589550c1-28e1-4e06-86cb-4e824650a773 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:38.489693 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-589550c1-28e1-4e06-86cb-4e824650a773 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:38.490133 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-589550c1-28e1-4e06-86cb-4e824650a773 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:38.490963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-589550c1-28e1-4e06-86cb-4e824650a773 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:38.491539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-589550c1-28e1-4e06-86cb-4e824650a773 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:38.806577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-f42bf2cf-fc1a-4080-acff-453968c5e34a req-7333d10d-c60d-4eb8-9940-15d1d7f5a337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8146718e-1357-4016-ade0-b8c505398786", "tag": "e195414b-7b53-40b2-90a6-297f183a70d4"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:38.807773 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-589550c1-28e1-4e06-86cb-4e824650a773 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:38.815976 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f42bf2cf-fc1a-4080-acff-453968c5e34a req-7333d10d-c60d-4eb8-9940-15d1d7f5a337 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:38.816709 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f42bf2cf-fc1a-4080-acff-453968c5e34a req-7333d10d-c60d-4eb8-9940-15d1d7f5a337 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:38.822079 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-589550c1-28e1-4e06-86cb-4e824650a773 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.345695 Jun 23 08:24:38.822738 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:38.823092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 298/579] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:38 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:38.834811 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-f42bf2cf-fc1a-4080-acff-453968c5e34a req-7333d10d-c60d-4eb8-9940-15d1d7f5a337 service nova] Creating event network-changed:e195414b-7b53-40b2-90a6-297f183a70d4 for instance 8146718e-1357-4016-ade0-b8c505398786 on hv-cinder-84721 Jun 23 08:24:38.842562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-f42bf2cf-fc1a-4080-acff-453968c5e34a req-7333d10d-c60d-4eb8-9940-15d1d7f5a337 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040123 Jun 23 08:24:38.843536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 282/580] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:39.049384 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:39.050090 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:39.056440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:39.056883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:39.057643 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:39.058135 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:39.283713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:39.291900 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:39.293435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:39.294610 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a10cf631-f75b-4733-99ff-9d7aa6ae452d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.249334 Jun 23 08:24:39.295181 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 299/581] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:39 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:39.356700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:39.357463 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] [instance: b633ac69-2692-493b-832c-15eabce9ecf0] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:39.365415 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:39.368487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:39.369382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:39.369800 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:39.384925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] HTTP exception thrown: Instance b633ac69-2692-493b-832c-15eabce9ecf0 could not be found. Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Request method failure captured: Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 HTTP/1.1 Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCMT-C22Dtk_gX4pqgeFyVv3kVTFKuZz8G7KFEMttv12c2FxHrZ9LGb4XKyVoLgLwMrKG3w5ctHaszc2fAE6r-2D-JOj6FPxRvTVy17SurOOognzEzK_p2OYFZ411lF5n0x-54z3V5s3wssoN4MhkwIMU56vAsGwGCgT2vieYDXlRqg Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: bf86466e66274193b5c2b0fdf69884b5 Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-VolumesNegativeTest-1618110309 Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:24:39.386638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bf86466e66274193b5c2b0fdf69884b5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bf86466e66274193b5c2b0fdf69884b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bf86466e66274193b5c2b0fdf69884b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bf86466e66274193b5c2b0fdf69884b5"}]}] Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-VolumesNegativeTest-1618110309 Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: bf86466e66274193b5c2b0fdf69884b5 Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-VolumesNegativeTest-1618110309 Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-VolumesNegativeTest-1618110309-project Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 578195adbe574c67a6de17a17513f545 Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-VolumesNegativeTest-1618110309-project Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance b633ac69-2692-493b-832c-15eabce9ecf0 could not be found. Jun 23 08:24:39.388078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': 'b633ac69-2692-493b-832c-15eabce9ecf0'} Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b633ac69-2692-493b-832c-15eabce9ecf0 could not be found. Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:24:39.388953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b633ac69-2692-493b-832c-15eabce9ecf0 could not be found. Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b633ac69-2692-493b-832c-15eabce9ecf0 could not be found. Jun 23 08:24:39.390387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:24:39.391681 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] Returning 404 to user: Instance b633ac69-2692-493b-832c-15eabce9ecf0 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:24:39.391681 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e9c659d9-fc91-47d5-82c1-8f5dad569e14 tempest-VolumesNegativeTest-1618110309 tempest-VolumesNegativeTest-1618110309-project] 10.222.0.33 "GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0" status: 404 len: 111 microversion: 2.1 time: 0.035939 Jun 23 08:24:39.392052 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 283/582] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:39 2022] GET /compute/v2.1/servers/b633ac69-2692-493b-832c-15eabce9ecf0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:24:39.463792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-22f762c9-393f-46b8-98c0-159550c78743 req-e114cadb-ab0c-4cad-9e84-983eb69dc121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc92fdb9-d1dd-4771-b503-766a91a813e9", "tag": "8490cc9a-79c6-4e36-b7ae-2c291e958bcf"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:39.473069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-22f762c9-393f-46b8-98c0-159550c78743 req-e114cadb-ab0c-4cad-9e84-983eb69dc121 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:39.473520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-22f762c9-393f-46b8-98c0-159550c78743 req-e114cadb-ab0c-4cad-9e84-983eb69dc121 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:39.493171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-22f762c9-393f-46b8-98c0-159550c78743 req-e114cadb-ab0c-4cad-9e84-983eb69dc121 service nova] Creating event network-changed:8490cc9a-79c6-4e36-b7ae-2c291e958bcf for instance dc92fdb9-d1dd-4771-b503-766a91a813e9 on hv-cinder-84721 Jun 23 08:24:39.499630 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-22f762c9-393f-46b8-98c0-159550c78743 req-e114cadb-ab0c-4cad-9e84-983eb69dc121 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040880 Jun 23 08:24:39.500489 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 300/583] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:39.840735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-fe27f7e7-22a4-4a27-977c-29fecc91e5c8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:39.841353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-fe27f7e7-22a4-4a27-977c-29fecc91e5c8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:39.847474 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fe27f7e7-22a4-4a27-977c-29fecc91e5c8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:39.847902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fe27f7e7-22a4-4a27-977c-29fecc91e5c8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:39.848672 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fe27f7e7-22a4-4a27-977c-29fecc91e5c8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:39.849100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fe27f7e7-22a4-4a27-977c-29fecc91e5c8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:40.010342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fe27f7e7-22a4-4a27-977c-29fecc91e5c8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:40.018950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-fe27f7e7-22a4-4a27-977c-29fecc91e5c8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.182899 Jun 23 08:24:40.023246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 284/584] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:39 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:40.313595 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:40.314171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:40.320636 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:40.321092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:40.322229 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:40.322765 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:40.494707 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:40.514310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:40.516153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:40.517704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a5103b40-4543-463d-bb64-098b2605978f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.208794 Jun 23 08:24:40.528178 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 301/585] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:40 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:41.036678 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-780f9906-081c-4e3e-a68a-61461ea9edc4 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:41.037434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-780f9906-081c-4e3e-a68a-61461ea9edc4 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:41.040759 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:41.042022 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=8 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:41.049327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-780f9906-081c-4e3e-a68a-61461ea9edc4 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:41.049781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-780f9906-081c-4e3e-a68a-61461ea9edc4 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:41.050551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-780f9906-081c-4e3e-a68a-61461ea9edc4 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:41.050982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-780f9906-081c-4e3e-a68a-61461ea9edc4 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:41.191585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-780f9906-081c-4e3e-a68a-61461ea9edc4 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:41.200342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-780f9906-081c-4e3e-a68a-61461ea9edc4 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.167600 Jun 23 08:24:41.200928 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 285/586] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:41 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:41.538241 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:41.538817 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:41.545839 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:41.546360 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:41.547186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:41.547713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:41.680235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:41.689649 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:41.691239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:41.692633 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3035c09d-c197-4852-a520-5deb5381234c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.158335 Jun 23 08:24:41.693403 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 302/587] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:41 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:42.216873 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5765ede6-6a42-458e-95dc-4ed00618829c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:42.218226 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5765ede6-6a42-458e-95dc-4ed00618829c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:42.225550 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5765ede6-6a42-458e-95dc-4ed00618829c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:42.226071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5765ede6-6a42-458e-95dc-4ed00618829c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:42.226916 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5765ede6-6a42-458e-95dc-4ed00618829c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:42.227428 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5765ede6-6a42-458e-95dc-4ed00618829c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:42.501151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5765ede6-6a42-458e-95dc-4ed00618829c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:42.509795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5765ede6-6a42-458e-95dc-4ed00618829c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.296746 Jun 23 08:24:42.511042 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 286/588] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:42 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:42.711248 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:42.712050 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:42.718958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:42.719437 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:42.720201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:42.720621 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:42.855369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:42.863769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:42.865245 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:42.866395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-527e85bf-ba96-481e-a9d8-65ede8323350 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.159219 Jun 23 08:24:42.866964 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 303/589] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:42 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:43.527379 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c74b5efc-12ac-4144-8013-83850e95f208 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:43.528021 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c74b5efc-12ac-4144-8013-83850e95f208 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:43.534972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c74b5efc-12ac-4144-8013-83850e95f208 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:43.535453 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c74b5efc-12ac-4144-8013-83850e95f208 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:43.536220 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c74b5efc-12ac-4144-8013-83850e95f208 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:43.536669 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c74b5efc-12ac-4144-8013-83850e95f208 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:43.667919 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c74b5efc-12ac-4144-8013-83850e95f208 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:43.675866 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c74b5efc-12ac-4144-8013-83850e95f208 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.152442 Jun 23 08:24:43.676424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 287/590] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:43 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:43.885354 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:43.886049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:43.900641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:43.901183 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:43.902040 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:43.902552 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:44.037140 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:44.045896 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:44.047539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:44.048957 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f8e65030-44bd-482f-9ba2-6c2865be9483 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.167716 Jun 23 08:24:44.049611 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 304/591] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:43 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:44.693316 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c1de4df0-aaf2-4891-b640-e20fcf953e98 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:44.694730 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c1de4df0-aaf2-4891-b640-e20fcf953e98 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:44.703884 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c1de4df0-aaf2-4891-b640-e20fcf953e98 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:44.704607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c1de4df0-aaf2-4891-b640-e20fcf953e98 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:44.705670 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c1de4df0-aaf2-4891-b640-e20fcf953e98 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:44.706473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c1de4df0-aaf2-4891-b640-e20fcf953e98 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:44.887590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c1de4df0-aaf2-4891-b640-e20fcf953e98 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:44.895191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c1de4df0-aaf2-4891-b640-e20fcf953e98 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.206261 Jun 23 08:24:44.895877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 288/592] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:44 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:45.067956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:45.068579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:45.078832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:45.079363 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:45.080088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:45.080522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:45.213815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:45.222035 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:45.223695 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:45.224847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-23a087cd-bc28-4e16-879b-6311c6986e94 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.160928 Jun 23 08:24:45.225398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 305/593] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:45 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:45.911822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-317f0143-8ead-4733-8c64-76a59d45c3b8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:45.912535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-317f0143-8ead-4733-8c64-76a59d45c3b8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:45.919574 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-317f0143-8ead-4733-8c64-76a59d45c3b8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:45.921097 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-317f0143-8ead-4733-8c64-76a59d45c3b8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:45.922788 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-317f0143-8ead-4733-8c64-76a59d45c3b8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:45.923285 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-317f0143-8ead-4733-8c64-76a59d45c3b8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:46.132571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-157a2dcc-a96e-4136-afb4-9934f2f0991a req-9bd644b8-45a7-40c5-a554-d2bcaf9a2520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8146718e-1357-4016-ade0-b8c505398786", "name": "network-vif-plugged", "status": "completed", "tag": "e195414b-7b53-40b2-90a6-297f183a70d4"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:46.143787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-157a2dcc-a96e-4136-afb4-9934f2f0991a req-9bd644b8-45a7-40c5-a554-d2bcaf9a2520 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:46.144302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-157a2dcc-a96e-4136-afb4-9934f2f0991a req-9bd644b8-45a7-40c5-a554-d2bcaf9a2520 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:46.153168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-317f0143-8ead-4733-8c64-76a59d45c3b8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:46.160834 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-317f0143-8ead-4733-8c64-76a59d45c3b8 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.252901 Jun 23 08:24:46.161200 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-157a2dcc-a96e-4136-afb4-9934f2f0991a req-9bd644b8-45a7-40c5-a554-d2bcaf9a2520 service nova] Creating event network-vif-plugged:e195414b-7b53-40b2-90a6-297f183a70d4 for instance 8146718e-1357-4016-ade0-b8c505398786 on hv-cinder-84721 Jun 23 08:24:46.168661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-157a2dcc-a96e-4136-afb4-9934f2f0991a req-9bd644b8-45a7-40c5-a554-d2bcaf9a2520 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039598 Jun 23 08:24:46.170667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 306/594] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:46.170925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 289/595] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:45 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:46.245553 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:46.247026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:46.255499 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:46.256487 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:46.257334 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:46.258000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:46.492224 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:46.502805 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:46.504348 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:46.505507 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5c98bef1-9e9a-40b7-a7ca-bb025174a06e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.265068 Jun 23 08:24:46.508883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 307/596] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:46 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:47.178062 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-509a3dd6-467f-447b-84fe-f9fad6e7068c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:47.178672 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-509a3dd6-467f-447b-84fe-f9fad6e7068c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:47.185815 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-509a3dd6-467f-447b-84fe-f9fad6e7068c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:47.186257 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-509a3dd6-467f-447b-84fe-f9fad6e7068c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:47.187029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-509a3dd6-467f-447b-84fe-f9fad6e7068c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:47.187496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-509a3dd6-467f-447b-84fe-f9fad6e7068c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:47.351242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-509a3dd6-467f-447b-84fe-f9fad6e7068c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:47.363588 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-509a3dd6-467f-447b-84fe-f9fad6e7068c tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.189117 Jun 23 08:24:47.364273 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 290/597] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:47 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:47.526198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:47.526796 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:47.529806 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=82 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:47.535604 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:47.536391 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:47.548336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:47.548951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:47.778776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:47.789097 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:47.790646 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:47.792303 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2b9bbba1-993b-4b78-baef-1fe004585bef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.271420 Jun 23 08:24:47.793525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 308/598] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:47 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:48.382166 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d89aa74a-8ca5-487f-8e84-e765e9eb3f91 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:48.382778 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d89aa74a-8ca5-487f-8e84-e765e9eb3f91 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:48.390577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d89aa74a-8ca5-487f-8e84-e765e9eb3f91 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:48.391077 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d89aa74a-8ca5-487f-8e84-e765e9eb3f91 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:48.391960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d89aa74a-8ca5-487f-8e84-e765e9eb3f91 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:48.392452 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d89aa74a-8ca5-487f-8e84-e765e9eb3f91 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:48.570357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d89aa74a-8ca5-487f-8e84-e765e9eb3f91 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:48.582353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d89aa74a-8ca5-487f-8e84-e765e9eb3f91 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1319 microversion: 2.1 time: 0.204010 Jun 23 08:24:48.585859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 291/599] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:48 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:48.813925 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:48.814677 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:48.821452 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:48.821999 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:48.822852 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:48.823583 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:49.034604 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:49.042998 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:49.045514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:49.047296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-895e10de-06fb-49e9-9df3-8f95d16bb1d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.237605 Jun 23 08:24:49.058360 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 309/600] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:48 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:49.601794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7bddee31-fccc-474d-bf49-527935991cc3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:49.602396 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7bddee31-fccc-474d-bf49-527935991cc3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:49.609555 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7bddee31-fccc-474d-bf49-527935991cc3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:49.610076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7bddee31-fccc-474d-bf49-527935991cc3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:49.610953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7bddee31-fccc-474d-bf49-527935991cc3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:49.611480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7bddee31-fccc-474d-bf49-527935991cc3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:49.765998 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7bddee31-fccc-474d-bf49-527935991cc3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:49.775148 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7bddee31-fccc-474d-bf49-527935991cc3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1508 microversion: 2.1 time: 0.177074 Jun 23 08:24:49.788962 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 292/601] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:24:49 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:24:49.795967 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7d02e3f1-c47d-4076-a9f4-ff230633e11d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdcd1982-573f-48f7-b8fb-1758b6355561", "device": "/dev/sdb"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:49.798324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7d02e3f1-c47d-4076-a9f4-ff230633e11d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:49.806514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7d02e3f1-c47d-4076-a9f4-ff230633e11d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:49.807913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7d02e3f1-c47d-4076-a9f4-ff230633e11d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:49.809034 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7d02e3f1-c47d-4076-a9f4-ff230633e11d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:49.809879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7d02e3f1-c47d-4076-a9f4-ff230633e11d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:50.067367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:50.068079 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:50.079332 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:50.079933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:50.082498 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:50.084107 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:50.253117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7d02e3f1-c47d-4076-a9f4-ff230633e11d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "POST /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.463217 Jun 23 08:24:50.256569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 310/602] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:24:49 2022] POST /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:50.351607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:50.362232 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:50.363954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:50.365110 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bf5fce69-c317-40e9-afde-59cf79c1168b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.302978 Jun 23 08:24:50.376828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 293/603] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:50 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:51.386392 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:51.387711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:51.395742 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:51.396243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:51.397024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:51.397455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:51.608923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:51.617435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:51.618923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:51.620124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3cf6b966-1c83-4ef3-8cd3-a3bc25dd7970 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1744 microversion: 2.20 time: 0.239864 Jun 23 08:24:51.621024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 311/604] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:51 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1744 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:52.641474 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:52.642058 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:52.650554 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:52.650997 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:52.651807 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:52.652229 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:52.893109 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:52.907403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:52.909124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:52.910848 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0d241e85-8d8c-41bd-9e5b-0cdfc1135475 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1744 microversion: 2.20 time: 0.273171 Jun 23 08:24:52.916575 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 294/605] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:52 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1744 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:53.929747 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:53.930311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:53.944609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:53.945056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:53.945837 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:53.952033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:53.981437 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:24:54.177883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:54.192119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:54.194521 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:54.195969 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cdd3f92e-d6bd-4764-bd43-eabcb035de95 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1744 microversion: 2.20 time: 0.270423 Jun 23 08:24:54.208070 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 312/606] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:53 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1744 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:55.219284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:55.220476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:55.228418 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:55.228937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:55.229774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:55.230405 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:55.382472 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:55.390950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:55.392459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:55.393708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-479b68af-0c05-415a-8548-bbd476f3a9a3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1744 microversion: 2.20 time: 0.183357 Jun 23 08:24:55.405843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 295/607] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:55 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:56.412095 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:56.413550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:56.420737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:56.421261 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:56.422089 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:56.422578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:56.582495 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:56.590958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:56.593712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:56.595121 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3ec632c4-a9ab-4d14-bfe4-3e79dd73ab34 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1744 microversion: 2.20 time: 0.186955 Jun 23 08:24:56.596164 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 313/608] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:56 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:56.809101 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-f034273f-a1bf-418d-ba55-61011c8f4d1c req-a4590d7d-5127-45e3-a3aa-accb73f7ae39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62a72a3-1376-4284-94a0-d57fbe81f1b9", "name": "network-vif-plugged", "status": "completed", "tag": "95dc486f-023d-4b75-87c7-155fbce47ca4"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:24:56.818835 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f034273f-a1bf-418d-ba55-61011c8f4d1c req-a4590d7d-5127-45e3-a3aa-accb73f7ae39 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:56.819655 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f034273f-a1bf-418d-ba55-61011c8f4d1c req-a4590d7d-5127-45e3-a3aa-accb73f7ae39 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:56.833072 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-f034273f-a1bf-418d-ba55-61011c8f4d1c req-a4590d7d-5127-45e3-a3aa-accb73f7ae39 service nova] Creating event network-vif-plugged:95dc486f-023d-4b75-87c7-155fbce47ca4 for instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 on hv-cinder-84721 Jun 23 08:24:56.856698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-f034273f-a1bf-418d-ba55-61011c8f4d1c req-a4590d7d-5127-45e3-a3aa-accb73f7ae39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051175 Jun 23 08:24:56.858242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 296/609] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:24:57.613713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:57.615875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:57.629176 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:57.630000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:57.633544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:57.634099 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:57.846386 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:57.860642 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:57.862727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:57.864129 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1dbfc4d4-3d2e-4f6a-a7ef-08436ed2cbfd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1744 microversion: 2.20 time: 0.254815 Jun 23 08:24:57.872043 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 314/610] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:57 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1744 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:24:58.889834 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:24:58.890522 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:24:58.909413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:58.909413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:58.909413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:24:58.909413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:24:59.119163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:59.130925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:59.132442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:24:59.134180 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-03285f44-88c4-4d39-b4e7-dff5ea1ec1a6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.248036 Jun 23 08:24:59.135190 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 297/611] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:24:58 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:00.153474 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:00.155282 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:00.164772 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:00.165526 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:00.166470 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:00.167064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:00.503056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:00.515577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:00.518482 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:00.528482 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-29c6688d-8c61-4a9c-9811-be71556d5e87 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.378880 Jun 23 08:25:00.529311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 315/612] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:00 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:01.602359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:01.603562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:01.626701 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:01.626701 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:01.626904 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:01.640126 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:01.646949 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:01.990712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:02.006222 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:02.008187 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:02.014632 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5ef1cc0f-43a4-49a4-97b5-066e14cac252 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.466726 Jun 23 08:25:02.015657 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 298/613] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:01 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:03.042077 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:03.043850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:03.055168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:03.059078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:03.061339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:03.062122 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:03.238369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:03.249543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:03.251375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:03.252721 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6775acab-2cb4-4c18-837d-711267ed96dd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.221334 Jun 23 08:25:03.253451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 316/614] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:03 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:04.286748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:04.288237 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:04.325189 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:04.325919 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:04.326823 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:04.327275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:04.601151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:04.617719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:04.644586 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:04.645985 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7b1cadcf-611b-4f6a-8d06-37333e41079f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.378162 Jun 23 08:25:04.651811 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 299/615] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:04 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:05.673619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:05.675094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:05.712373 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:05.714122 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:05.717667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:05.718401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:06.006152 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:06.026280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:06.028084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:06.029608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-730f5687-2d7a-446b-b053-f91a6bda86b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.363448 Jun 23 08:25:06.033204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 317/616] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:05 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:07.059410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:07.061742 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:07.075035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:07.076225 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:07.077583 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:07.078280 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:07.292407 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:07.296120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:07.304536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:07.306618 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:07.308258 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f41a6e0e-aa6b-4d9d-96b4-471541da0682 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.263668 Jun 23 08:25:07.309333 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 300/617] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:07 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:07.423164 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-aaa07c65-44c2-47fc-a80f-2af49b6283c5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Action: 'create', calling method: .version_select at 0x7feb62f98c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-897008801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFY3RzSjdSuewdkA1T80KPGkOCIpbRnGtGRGNpCyEMrVcdMmq4s+fAr2B3JJz4cr2kgWSCWKFPKQ+duUogFVZ6DqfplkMhLNq2GBBXXkEmnyl8A9Wlg4LEjdPK3RtpmFnA=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:07.440951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-aaa07c65-44c2-47fc-a80f-2af49b6283c5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Getting quotas for project 796208f488e742d1beaef6d02f0232e6. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:25:07.447774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-aaa07c65-44c2-47fc-a80f-2af49b6283c5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Getting quotas for user c685a84382ec4f4fbd3be4378ba14ca9 and project 796208f488e742d1beaef6d02f0232e6. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:25:07.474045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-aaa07c65-44c2-47fc-a80f-2af49b6283c5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054963 Jun 23 08:25:07.475268 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 318/618] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:25:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:25:07.541283 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1606027053", "imageRef": "5e594e0a-630b-4f12-b497-b635e706ae40", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-897008801", "networks": [{"uuid": "bc4d149f-2f3b-497c-a729-806757a56f68"}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:07.594974 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] validate_networks() for [('bc4d149f-2f3b-497c-a729-806757a56f68', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:25:08.007848 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:25:08.008311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:25:08.008934 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:25:08.009538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:25:08.009997 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:25:08.029748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:08.030191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:08.030961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:08.031407 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:08.057263 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Getting quotas for project 796208f488e742d1beaef6d02f0232e6. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:25:08.063574 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Getting quotas for user c685a84382ec4f4fbd3be4378ba14ca9 and project 796208f488e742d1beaef6d02f0232e6. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:25:08.079610 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:25:08.081979 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e594e0a-630b-4f12-b497-b635e706ae40',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:25:08.132773 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7360528c-945e-43ca-bbdd-80eca6ff8792 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595767 Jun 23 08:25:08.134074 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 301/619] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:25:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:25:08.145410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-356c420a-9cc3-4b2a-96c4-fe82232c6f6a tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:08.146617 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-356c420a-9cc3-4b2a-96c4-fe82232c6f6a tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:08.203704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-356c420a-9cc3-4b2a-96c4-fe82232c6f6a tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:08.215672 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-356c420a-9cc3-4b2a-96c4-fe82232c6f6a tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1258 microversion: 2.1 time: 0.074934 Jun 23 08:25:08.216733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 319/620] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:08 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:08.330760 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:08.332061 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:08.353011 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:08.356001 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:08.358168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:08.358964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:08.532179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:08.544400 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:08.546469 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:08.548108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ff48a18f-7ec2-4913-ba47-7924c0978eb7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.221774 Jun 23 08:25:08.549188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 302/621] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:08 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:09.233977 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-fb9c594e-ac37-4008-9284-432f00f7824c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:09.236627 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-fb9c594e-ac37-4008-9284-432f00f7824c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:09.246449 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb9c594e-ac37-4008-9284-432f00f7824c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:09.247468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb9c594e-ac37-4008-9284-432f00f7824c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:09.248605 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb9c594e-ac37-4008-9284-432f00f7824c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:09.249402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb9c594e-ac37-4008-9284-432f00f7824c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:09.325941 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-fb9c594e-ac37-4008-9284-432f00f7824c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:09.334200 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-fb9c594e-ac37-4008-9284-432f00f7824c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1254 microversion: 2.1 time: 0.104732 Jun 23 08:25:09.335092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 320/622] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:09 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1254 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:09.566489 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:09.567081 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:09.574408 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:09.574826 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:09.575743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:09.576205 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:09.730128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:09.738980 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:09.740844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:09.742040 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9b0d0ac1-9629-45f0-b9ca-9dac02f962fd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.179623 Jun 23 08:25:09.742909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 303/623] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:09 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:10.352336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-01913953-2b92-4364-ba7d-3b6241b3a5af tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:10.352951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-01913953-2b92-4364-ba7d-3b6241b3a5af tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:10.360546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-01913953-2b92-4364-ba7d-3b6241b3a5af tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:10.361103 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-01913953-2b92-4364-ba7d-3b6241b3a5af tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:10.361920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-01913953-2b92-4364-ba7d-3b6241b3a5af tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:10.362754 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-01913953-2b92-4364-ba7d-3b6241b3a5af tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:10.641247 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-01913953-2b92-4364-ba7d-3b6241b3a5af tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:10.648738 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-01913953-2b92-4364-ba7d-3b6241b3a5af tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1254 microversion: 2.1 time: 0.300406 Jun 23 08:25:10.649299 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 321/624] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:10 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1254 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:10.761425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:10.763023 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:10.769885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:10.770328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:10.771104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:10.771585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:10.968618 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:10.977511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:10.978969 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:10.980178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-66382225-1b12-4d21-bfe2-ce6828119f5d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.223104 Jun 23 08:25:10.980727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 304/625] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:10 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:11.665275 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-eea3d347-b5b3-44b0-85a6-c4edac432689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:11.666711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-eea3d347-b5b3-44b0-85a6-c4edac432689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:11.674008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eea3d347-b5b3-44b0-85a6-c4edac432689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:11.674774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eea3d347-b5b3-44b0-85a6-c4edac432689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:11.675786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eea3d347-b5b3-44b0-85a6-c4edac432689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:11.676405 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eea3d347-b5b3-44b0-85a6-c4edac432689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:11.848036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-eea3d347-b5b3-44b0-85a6-c4edac432689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:11.856369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-eea3d347-b5b3-44b0-85a6-c4edac432689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.195125 Jun 23 08:25:11.856943 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 322/626] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:11 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:12.000349 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:12.001656 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:12.021098 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:12.021934 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:12.022905 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:12.023520 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:12.288324 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:12.302142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:12.303725 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:12.305262 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c3454aa6-bafd-437a-8e19-1d256862a3e6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1739 microversion: 2.20 time: 0.309577 Jun 23 08:25:12.306304 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 305/627] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:11 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:25:12.541019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-c9e22a86-ac18-47bc-85c7-8f5f8afaabba req-7cb36517-0621-43e5-8c06-c1be91d45fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3ae113-1126-44da-8b3a-42e7f777a8c7", "tag": "45988a1f-4c36-4aab-9724-eb0b20919aef"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:12.550864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c9e22a86-ac18-47bc-85c7-8f5f8afaabba req-7cb36517-0621-43e5-8c06-c1be91d45fdf service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:12.551654 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c9e22a86-ac18-47bc-85c7-8f5f8afaabba req-7cb36517-0621-43e5-8c06-c1be91d45fdf service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:12.581807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-c9e22a86-ac18-47bc-85c7-8f5f8afaabba req-7cb36517-0621-43e5-8c06-c1be91d45fdf service nova] Creating event network-changed:45988a1f-4c36-4aab-9724-eb0b20919aef for instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 on hv-cinder-84721 Jun 23 08:25:12.587472 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-c9e22a86-ac18-47bc-85c7-8f5f8afaabba req-7cb36517-0621-43e5-8c06-c1be91d45fdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050543 Jun 23 08:25:12.588467 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 323/628] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:25:12.873862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-65183f92-e80e-4fb4-936f-c550df20218e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:12.874473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-65183f92-e80e-4fb4-936f-c550df20218e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:12.881370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65183f92-e80e-4fb4-936f-c550df20218e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:12.881848 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65183f92-e80e-4fb4-936f-c550df20218e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:12.882608 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65183f92-e80e-4fb4-936f-c550df20218e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:12.883009 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65183f92-e80e-4fb4-936f-c550df20218e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:13.090765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-65183f92-e80e-4fb4-936f-c550df20218e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:13.108068 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-65183f92-e80e-4fb4-936f-c550df20218e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.238797 Jun 23 08:25:13.117518 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 306/629] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:12 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:13.326658 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:13.327431 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:13.334097 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:13.334756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:13.335726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:13.336160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:13.564829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:13.577610 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:13.579169 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:13.580401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c8069e74-f897-404e-a5ec-ba383425191f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.258979 Jun 23 08:25:13.580960 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 324/630] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:13 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:14.125873 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9c678462-3eb8-42ca-8bba-70fef3dd0d3c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:14.126570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9c678462-3eb8-42ca-8bba-70fef3dd0d3c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:14.133249 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c678462-3eb8-42ca-8bba-70fef3dd0d3c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:14.133693 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c678462-3eb8-42ca-8bba-70fef3dd0d3c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:14.134478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c678462-3eb8-42ca-8bba-70fef3dd0d3c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:14.134920 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c678462-3eb8-42ca-8bba-70fef3dd0d3c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:14.287459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9c678462-3eb8-42ca-8bba-70fef3dd0d3c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:14.294848 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9c678462-3eb8-42ca-8bba-70fef3dd0d3c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.173578 Jun 23 08:25:14.295638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 307/631] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:14 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:14.591106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-afcf041d-eb00-42ff-87c7-d7735031d519 req-3efde49c-a7c1-465e-ad64-65b80ff1b52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62a72a3-1376-4284-94a0-d57fbe81f1b9", "name": "network-vif-unplugged", "status": "completed", "tag": "95dc486f-023d-4b75-87c7-155fbce47ca4"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:14.600809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:14.601372 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:14.601802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-afcf041d-eb00-42ff-87c7-d7735031d519 req-3efde49c-a7c1-465e-ad64-65b80ff1b52f service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:14.602363 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-afcf041d-eb00-42ff-87c7-d7735031d519 req-3efde49c-a7c1-465e-ad64-65b80ff1b52f service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:14.610881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:14.612720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:14.613841 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:14.614570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:14.617920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-afcf041d-eb00-42ff-87c7-d7735031d519 req-3efde49c-a7c1-465e-ad64-65b80ff1b52f service nova] Creating event network-vif-unplugged:95dc486f-023d-4b75-87c7-155fbce47ca4 for instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 on hv-cinder-84721 Jun 23 08:25:14.626131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-afcf041d-eb00-42ff-87c7-d7735031d519 req-3efde49c-a7c1-465e-ad64-65b80ff1b52f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038156 Jun 23 08:25:14.627352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 325/632] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:25:14.778046 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:14.788224 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:14.789932 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:14.791362 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-30906208-aa0b-4f1f-aa13-cfdc4c13ad9a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.195130 Jun 23 08:25:14.792671 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 308/633] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:14 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:15.313244 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f33cb1b7-6dae-410f-b43c-74b5a49d119b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:15.314099 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f33cb1b7-6dae-410f-b43c-74b5a49d119b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:15.321590 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f33cb1b7-6dae-410f-b43c-74b5a49d119b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:15.322053 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f33cb1b7-6dae-410f-b43c-74b5a49d119b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:15.322860 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f33cb1b7-6dae-410f-b43c-74b5a49d119b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:15.323316 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f33cb1b7-6dae-410f-b43c-74b5a49d119b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:15.456920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f33cb1b7-6dae-410f-b43c-74b5a49d119b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:15.468903 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f33cb1b7-6dae-410f-b43c-74b5a49d119b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.159278 Jun 23 08:25:15.469919 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 326/634] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:15 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:15.559137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c383b22b-1d82-411e-8550-c6353ba18d1d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:15.560783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c383b22b-1d82-411e-8550-c6353ba18d1d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:15.569166 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c383b22b-1d82-411e-8550-c6353ba18d1d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:15.569590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c383b22b-1d82-411e-8550-c6353ba18d1d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:15.570683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c383b22b-1d82-411e-8550-c6353ba18d1d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:15.571118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c383b22b-1d82-411e-8550-c6353ba18d1d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:15.701948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-c383b22b-1d82-411e-8550-c6353ba18d1d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lazy-loading 'services' on Instance uuid 8146718e-1357-4016-ade0-b8c505398786 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:25:15.811516 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:15.812251 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:15.818198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c383b22b-1d82-411e-8550-c6353ba18d1d tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786/os-volume_attachments/cdcd1982-573f-48f7-b8fb-1758b6355561" status: 202 len: 0 microversion: 2.1 time: 0.263235 Jun 23 08:25:15.818829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 309/635] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:25:15 2022] DELETE /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786/os-volume_attachments/cdcd1982-573f-48f7-b8fb-1758b6355561 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:25:15.819542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:15.820000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:15.820765 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:15.821193 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:16.004256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:16.013339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:16.015703 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:16.016939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-137c0853-5c01-4eda-ada3-22a6d71a1a0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.210625 Jun 23 08:25:16.017543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 327/636] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:15 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:16.492100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1f257dc3-58c5-4045-92bd-5fae90deccc8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:16.492820 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1f257dc3-58c5-4045-92bd-5fae90deccc8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:16.500585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1f257dc3-58c5-4045-92bd-5fae90deccc8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:16.501028 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1f257dc3-58c5-4045-92bd-5fae90deccc8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:16.501800 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1f257dc3-58c5-4045-92bd-5fae90deccc8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:16.502233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1f257dc3-58c5-4045-92bd-5fae90deccc8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:16.674265 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1f257dc3-58c5-4045-92bd-5fae90deccc8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:16.681968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1f257dc3-58c5-4045-92bd-5fae90deccc8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.194186 Jun 23 08:25:16.682508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 310/637] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:16 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:17.036273 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:17.037078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:17.044302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:17.044750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:17.045598 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:17.046119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:17.211581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:17.219818 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:17.221380 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:17.222549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4ae94845-ffaa-4636-955d-3e89f15c30ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.190464 Jun 23 08:25:17.223113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 328/638] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:17 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:17.703905 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b1ac7599-09c2-4b00-ac0e-06ba0fe43332 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:17.705542 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b1ac7599-09c2-4b00-ac0e-06ba0fe43332 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:17.712814 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b1ac7599-09c2-4b00-ac0e-06ba0fe43332 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:17.713319 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b1ac7599-09c2-4b00-ac0e-06ba0fe43332 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:17.714170 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b1ac7599-09c2-4b00-ac0e-06ba0fe43332 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:17.714659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b1ac7599-09c2-4b00-ac0e-06ba0fe43332 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:17.860423 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b1ac7599-09c2-4b00-ac0e-06ba0fe43332 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:17.868077 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b1ac7599-09c2-4b00-ac0e-06ba0fe43332 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.168635 Jun 23 08:25:17.868636 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 311/639] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:17 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:18.247491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=6 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:18.435038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:18.436001 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:18.438652 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:18.446771 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:18.447358 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:18.448506 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:18.449203 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:18.586664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:18.596777 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:18.598319 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:18.599507 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-759652fe-3387-44af-b53f-cfc10e8f90d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.361186 Jun 23 08:25:18.600067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 329/640] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:18 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:18.890701 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0c81af70-26c5-4473-8143-973526df659e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:18.891763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0c81af70-26c5-4473-8143-973526df659e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:18.894925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:18.896044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:18.905692 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c81af70-26c5-4473-8143-973526df659e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:18.906141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c81af70-26c5-4473-8143-973526df659e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:18.906923 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c81af70-26c5-4473-8143-973526df659e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:18.907384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c81af70-26c5-4473-8143-973526df659e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:19.053125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0c81af70-26c5-4473-8143-973526df659e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:19.062718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0c81af70-26c5-4473-8143-973526df659e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.179323 Jun 23 08:25:19.063477 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 312/641] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:18 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:19.618450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:19.620499 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:19.628771 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:19.629542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:19.631021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:19.632206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:19.779326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:19.788106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:19.789633 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:19.790786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bc09760d-71e3-4d68-9320-4d2883097045 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.176509 Jun 23 08:25:19.800858 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 330/642] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:19 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:20.082076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-521fd89f-1992-43ba-bc4a-9cd64cd45b54 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:20.082761 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-521fd89f-1992-43ba-bc4a-9cd64cd45b54 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:20.090053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-521fd89f-1992-43ba-bc4a-9cd64cd45b54 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:20.090547 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-521fd89f-1992-43ba-bc4a-9cd64cd45b54 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:20.091336 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-521fd89f-1992-43ba-bc4a-9cd64cd45b54 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:20.091938 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-521fd89f-1992-43ba-bc4a-9cd64cd45b54 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:20.273449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-521fd89f-1992-43ba-bc4a-9cd64cd45b54 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:20.284287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-521fd89f-1992-43ba-bc4a-9cd64cd45b54 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.206945 Jun 23 08:25:20.284885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 313/643] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:20 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:20.814798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:20.815437 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:20.822720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:20.823175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:20.823999 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:20.824449 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:20.976734 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:20.988792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:20.991453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:20.993629 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-94321c6e-6508-46b5-b5b8-f3ee92fb203b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.186054 Jun 23 08:25:20.994535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 331/644] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:20 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:21.301468 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7e1d8bec-64b2-418f-b1c7-eedc7455d695 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:21.302241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7e1d8bec-64b2-418f-b1c7-eedc7455d695 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:21.308946 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7e1d8bec-64b2-418f-b1c7-eedc7455d695 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:21.309641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7e1d8bec-64b2-418f-b1c7-eedc7455d695 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:21.310411 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7e1d8bec-64b2-418f-b1c7-eedc7455d695 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:21.310831 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7e1d8bec-64b2-418f-b1c7-eedc7455d695 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:21.470090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7e1d8bec-64b2-418f-b1c7-eedc7455d695 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:21.478502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7e1d8bec-64b2-418f-b1c7-eedc7455d695 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.181223 Jun 23 08:25:21.479095 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 314/645] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:21 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:22.015147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:22.016108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:22.025027 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:22.025467 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:22.026587 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:22.027186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:22.053337 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:22.172905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:22.181478 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:22.182964 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:22.184157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-81242d55-293c-4c2d-8b8b-154f7778369f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.174049 Jun 23 08:25:22.184709 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 332/646] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:22 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:22.496485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-72af64d5-72af-4248-8fcc-8c96fcca3cd2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:22.497205 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-72af64d5-72af-4248-8fcc-8c96fcca3cd2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:22.504124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-72af64d5-72af-4248-8fcc-8c96fcca3cd2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:22.504577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-72af64d5-72af-4248-8fcc-8c96fcca3cd2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:22.505327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-72af64d5-72af-4248-8fcc-8c96fcca3cd2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:22.505754 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-72af64d5-72af-4248-8fcc-8c96fcca3cd2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:22.651913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-72af64d5-72af-4248-8fcc-8c96fcca3cd2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:22.659810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-72af64d5-72af-4248-8fcc-8c96fcca3cd2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.167679 Jun 23 08:25:22.660401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 315/647] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:22 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:23.206832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:23.207939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:23.219198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:23.219983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:23.221452 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:23.221909 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:23.365473 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:23.373945 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:23.375581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:23.376730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ed9c08ae-a681-4754-8651-da4769122896 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.176911 Jun 23 08:25:23.377322 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 333/648] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:23 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:23.677661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-179db559-1d35-47ef-a371-e589a2b7ac4d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:23.678322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-179db559-1d35-47ef-a371-e589a2b7ac4d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:23.685656 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-179db559-1d35-47ef-a371-e589a2b7ac4d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:23.686089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-179db559-1d35-47ef-a371-e589a2b7ac4d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:23.686855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-179db559-1d35-47ef-a371-e589a2b7ac4d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:23.687317 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-179db559-1d35-47ef-a371-e589a2b7ac4d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:23.833419 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-179db559-1d35-47ef-a371-e589a2b7ac4d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:23.841171 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-179db559-1d35-47ef-a371-e589a2b7ac4d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.167444 Jun 23 08:25:23.841706 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 316/649] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:23 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:24.396170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:24.396794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:24.403621 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:24.404058 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:24.404811 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:24.405253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:24.562249 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:24.570844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:24.572265 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:24.573442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c053c7d9-d739-4ab4-80e4-e13e40310a26 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.182270 Jun 23 08:25:24.573993 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 334/650] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:24 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:24.859666 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-19bf89af-a88b-4b69-ac7d-62e5fd879828 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:24.860297 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-19bf89af-a88b-4b69-ac7d-62e5fd879828 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:24.866840 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-19bf89af-a88b-4b69-ac7d-62e5fd879828 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:24.867326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-19bf89af-a88b-4b69-ac7d-62e5fd879828 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:24.868089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-19bf89af-a88b-4b69-ac7d-62e5fd879828 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:24.868515 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-19bf89af-a88b-4b69-ac7d-62e5fd879828 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:24.884026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:25.008878 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-19bf89af-a88b-4b69-ac7d-62e5fd879828 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:25.016689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-19bf89af-a88b-4b69-ac7d-62e5fd879828 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.161350 Jun 23 08:25:25.017285 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 317/651] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:24 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:25.593173 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:25.594200 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:25.601029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:25.601462 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:25.602220 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:25.602644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:25.750797 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:25.760560 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:25.762120 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:25.763527 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4e85a241-77ee-4c39-92a2-b599ee59657d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.175323 Jun 23 08:25:25.764114 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 335/652] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:25 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:26.038509 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-114c1166-32b6-4ac4-9b26-9803b953676e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:26.039272 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-114c1166-32b6-4ac4-9b26-9803b953676e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:26.046054 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-114c1166-32b6-4ac4-9b26-9803b953676e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:26.046493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-114c1166-32b6-4ac4-9b26-9803b953676e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:26.047236 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-114c1166-32b6-4ac4-9b26-9803b953676e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:26.047700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-114c1166-32b6-4ac4-9b26-9803b953676e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:26.185218 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-114c1166-32b6-4ac4-9b26-9803b953676e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:26.193460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-114c1166-32b6-4ac4-9b26-9803b953676e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.162013 Jun 23 08:25:26.194037 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 318/653] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:26 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:26.784149 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:26.785614 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:26.792958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:26.793866 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:26.794861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:26.795510 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:26.937081 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:26.947858 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:26.949673 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:26.950873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e139e56c-5b48-479e-87a6-682d4c7db5b4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.171454 Jun 23 08:25:26.951487 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 336/654] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:26 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:27.214598 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bee223b8-8dea-4c92-abd7-0e51515bb283 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:27.215724 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bee223b8-8dea-4c92-abd7-0e51515bb283 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:27.227520 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bee223b8-8dea-4c92-abd7-0e51515bb283 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:27.228259 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bee223b8-8dea-4c92-abd7-0e51515bb283 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:27.229516 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bee223b8-8dea-4c92-abd7-0e51515bb283 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:27.230236 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bee223b8-8dea-4c92-abd7-0e51515bb283 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:27.374101 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bee223b8-8dea-4c92-abd7-0e51515bb283 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:27.382836 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bee223b8-8dea-4c92-abd7-0e51515bb283 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.174759 Jun 23 08:25:27.383460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 319/655] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:27 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:27.973601 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:27.974576 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:27.985674 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:27.986410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:27.987718 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:27.988436 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:28.134265 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:28.146293 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:28.147827 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:28.148958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-99f496da-a6f9-42fb-90a9-a2718f090157 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.181963 Jun 23 08:25:28.149519 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 337/656] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:27 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:28.404170 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8d31aae2-b0c6-4609-85d6-3836193a10e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:28.405144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8d31aae2-b0c6-4609-85d6-3836193a10e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:28.414127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8d31aae2-b0c6-4609-85d6-3836193a10e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:28.414569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8d31aae2-b0c6-4609-85d6-3836193a10e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:28.415363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8d31aae2-b0c6-4609-85d6-3836193a10e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:28.415789 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8d31aae2-b0c6-4609-85d6-3836193a10e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:28.557748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8d31aae2-b0c6-4609-85d6-3836193a10e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:28.569743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8d31aae2-b0c6-4609-85d6-3836193a10e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.171746 Jun 23 08:25:28.570601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 320/657] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:28 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:29.171737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:29.172681 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:29.183933 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:29.184670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:29.185923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:29.186643 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:29.323628 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:29.331729 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:29.333195 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:29.334573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2fc6d631-f34c-4d80-899c-0d51edbe29a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.169543 Jun 23 08:25:29.335125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 338/658] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:29 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:29.593459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-763b6aab-b682-440e-be4b-86b16a3d471c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:29.594891 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-763b6aab-b682-440e-be4b-86b16a3d471c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:29.606649 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-763b6aab-b682-440e-be4b-86b16a3d471c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:29.607430 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-763b6aab-b682-440e-be4b-86b16a3d471c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:29.608666 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-763b6aab-b682-440e-be4b-86b16a3d471c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:29.609369 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-763b6aab-b682-440e-be4b-86b16a3d471c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:29.742413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-763b6aab-b682-440e-be4b-86b16a3d471c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:29.750537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-763b6aab-b682-440e-be4b-86b16a3d471c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.164212 Jun 23 08:25:29.751100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 321/659] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:29 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:30.357147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:30.357824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:30.367177 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:30.367646 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:30.368445 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:30.368867 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:30.510890 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:30.519184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:30.520807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:30.522150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-abed2674-5393-4853-91e4-be4f67a1b671 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.171551 Jun 23 08:25:30.522714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 339/660] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:30 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:30.766908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-911b1979-c92a-409c-9cfa-9ee92c7176dc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:30.767546 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-911b1979-c92a-409c-9cfa-9ee92c7176dc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:30.774135 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-911b1979-c92a-409c-9cfa-9ee92c7176dc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:30.774574 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-911b1979-c92a-409c-9cfa-9ee92c7176dc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:30.775386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-911b1979-c92a-409c-9cfa-9ee92c7176dc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:30.775810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-911b1979-c92a-409c-9cfa-9ee92c7176dc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:30.905818 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-911b1979-c92a-409c-9cfa-9ee92c7176dc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:30.913960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-911b1979-c92a-409c-9cfa-9ee92c7176dc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.150720 Jun 23 08:25:30.914530 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 322/661] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:30 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:31.541231 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:31.541830 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:31.549045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:31.549489 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:31.550268 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:31.550696 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:31.693548 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:31.702229 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:31.703738 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:31.704861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6387ab9c-8998-4fce-a008-8314f804c47f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.168212 Jun 23 08:25:31.705457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 340/662] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:31 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:31.935685 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-db0893f5-3dc9-47bf-b319-97672edc5f37 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:31.936353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-db0893f5-3dc9-47bf-b319-97672edc5f37 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:31.942099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:31.944859 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-845b3dd8-6917-4a26-b87f-66982e51d9d7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:31.946284 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-845b3dd8-6917-4a26-b87f-66982e51d9d7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:31.947844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-db0893f5-3dc9-47bf-b319-97672edc5f37 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:31.948356 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-db0893f5-3dc9-47bf-b319-97672edc5f37 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:31.949351 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-db0893f5-3dc9-47bf-b319-97672edc5f37 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:31.950211 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-db0893f5-3dc9-47bf-b319-97672edc5f37 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:31.959450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-845b3dd8-6917-4a26-b87f-66982e51d9d7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:31.959939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-845b3dd8-6917-4a26-b87f-66982e51d9d7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:31.967161 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-845b3dd8-6917-4a26-b87f-66982e51d9d7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:31.967833 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-845b3dd8-6917-4a26-b87f-66982e51d9d7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:32.002338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-845b3dd8-6917-4a26-b87f-66982e51d9d7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:25:32.089394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-845b3dd8-6917-4a26-b87f-66982e51d9d7 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 204 len: 0 microversion: 2.1 time: 0.148525 Jun 23 08:25:32.090075 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 341/663] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:25:31 2022] DELETE /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:25:32.101491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cfdd09f8-9c6d-4bbc-8302-5896bc5bbda3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:32.102295 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cfdd09f8-9c6d-4bbc-8302-5896bc5bbda3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:32.108635 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cfdd09f8-9c6d-4bbc-8302-5896bc5bbda3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:32.109153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cfdd09f8-9c6d-4bbc-8302-5896bc5bbda3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:32.110026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cfdd09f8-9c6d-4bbc-8302-5896bc5bbda3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:32.110513 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cfdd09f8-9c6d-4bbc-8302-5896bc5bbda3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:32.166780 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-db0893f5-3dc9-47bf-b319-97672edc5f37 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:32.177731 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-db0893f5-3dc9-47bf-b319-97672edc5f37 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.250442 Jun 23 08:25:32.187825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 323/664] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:31 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:32.242097 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cfdd09f8-9c6d-4bbc-8302-5896bc5bbda3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:32.250018 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cfdd09f8-9c6d-4bbc-8302-5896bc5bbda3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1514 microversion: 2.1 time: 0.153224 Jun 23 08:25:32.250617 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 342/665] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:32 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:32.726846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:32.727616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:32.735638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:32.736191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:32.737121 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:32.737688 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:32.878352 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:32.887037 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:32.888562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:32.889717 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a922f850-8305-42de-b5a7-5dde10a5c2c4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.168676 Jun 23 08:25:32.890287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 324/666] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:32 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:33.198540 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-482156cd-7e00-4330-8e68-947bf590180e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:33.199605 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-482156cd-7e00-4330-8e68-947bf590180e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:33.209954 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-482156cd-7e00-4330-8e68-947bf590180e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:33.210401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-482156cd-7e00-4330-8e68-947bf590180e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:33.211153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-482156cd-7e00-4330-8e68-947bf590180e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:33.211624 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-482156cd-7e00-4330-8e68-947bf590180e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:33.267835 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-660d346d-8a3d-49d6-87dc-fd81864d5abd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:33.268508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-660d346d-8a3d-49d6-87dc-fd81864d5abd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:33.275730 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-660d346d-8a3d-49d6-87dc-fd81864d5abd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:33.276166 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-660d346d-8a3d-49d6-87dc-fd81864d5abd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:33.276953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-660d346d-8a3d-49d6-87dc-fd81864d5abd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:33.277368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-660d346d-8a3d-49d6-87dc-fd81864d5abd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:33.357422 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-482156cd-7e00-4330-8e68-947bf590180e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:33.365895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-482156cd-7e00-4330-8e68-947bf590180e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.173609 Jun 23 08:25:33.366479 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 343/667] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:33 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:33.415379 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-660d346d-8a3d-49d6-87dc-fd81864d5abd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:33.423373 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-660d346d-8a3d-49d6-87dc-fd81864d5abd tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1514 microversion: 2.1 time: 0.159646 Jun 23 08:25:33.423983 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 325/668] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:33 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:25:33.912745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:33.913736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:33.923706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:33.924436 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:33.925671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:33.926371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:34.061775 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:34.069997 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:34.071525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:34.072725 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e55c1972-7137-4196-8f85-d0bcbeff1fba tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.166908 Jun 23 08:25:34.073256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 344/669] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:33 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:34.384655 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b89d1182-a4e3-4ae9-a654-c4541d0b41a3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:34.385275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b89d1182-a4e3-4ae9-a654-c4541d0b41a3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:34.392767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b89d1182-a4e3-4ae9-a654-c4541d0b41a3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:34.393249 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b89d1182-a4e3-4ae9-a654-c4541d0b41a3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:34.394085 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b89d1182-a4e3-4ae9-a654-c4541d0b41a3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:34.394582 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b89d1182-a4e3-4ae9-a654-c4541d0b41a3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:34.448993 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-17394db7-a98a-45ca-b574-815754ea71ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:34.449864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-17394db7-a98a-45ca-b574-815754ea71ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:34.458394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-17394db7-a98a-45ca-b574-815754ea71ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:34.458896 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-17394db7-a98a-45ca-b574-815754ea71ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:34.460254 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-17394db7-a98a-45ca-b574-815754ea71ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:34.460883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-17394db7-a98a-45ca-b574-815754ea71ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:34.548489 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b89d1182-a4e3-4ae9-a654-c4541d0b41a3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:34.556313 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b89d1182-a4e3-4ae9-a654-c4541d0b41a3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.176319 Jun 23 08:25:34.556898 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 326/670] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:34 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:34.607064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-17394db7-a98a-45ca-b574-815754ea71ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:34.617869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-17394db7-a98a-45ca-b574-815754ea71ee tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1514 microversion: 2.1 time: 0.173429 Jun 23 08:25:34.618480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 345/671] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:34 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:35.091251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:35.091886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:35.098479 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:35.098927 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:35.099735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:35.100706 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:35.250618 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:35.259389 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:35.260875 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:35.262025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-38c38a8c-3442-4959-8f58-e7ae91496c84 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.174824 Jun 23 08:25:35.262582 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 327/672] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:35 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:35.576273 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-250fa8e6-3c03-44f4-9878-151685e7a643 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:35.577170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-250fa8e6-3c03-44f4-9878-151685e7a643 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:35.586623 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-250fa8e6-3c03-44f4-9878-151685e7a643 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:35.587069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-250fa8e6-3c03-44f4-9878-151685e7a643 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:35.587868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-250fa8e6-3c03-44f4-9878-151685e7a643 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:35.588297 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-250fa8e6-3c03-44f4-9878-151685e7a643 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:35.636035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-21042317-dbbe-4ddc-af25-1803e054b045 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:35.636645 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-21042317-dbbe-4ddc-af25-1803e054b045 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:35.643373 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-21042317-dbbe-4ddc-af25-1803e054b045 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:35.643810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-21042317-dbbe-4ddc-af25-1803e054b045 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:35.644566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-21042317-dbbe-4ddc-af25-1803e054b045 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:35.644988 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-21042317-dbbe-4ddc-af25-1803e054b045 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:35.726807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-250fa8e6-3c03-44f4-9878-151685e7a643 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:35.734538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-250fa8e6-3c03-44f4-9878-151685e7a643 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.164503 Jun 23 08:25:35.735104 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 346/673] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:35 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:35.775949 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-21042317-dbbe-4ddc-af25-1803e054b045 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:35.783883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-21042317-dbbe-4ddc-af25-1803e054b045 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1514 microversion: 2.1 time: 0.151632 Jun 23 08:25:35.784455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 328/674] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:35 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:36.285221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:36.286212 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:36.294267 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:36.294713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:36.295513 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:36.295943 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:36.314402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:36.446557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:36.459988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:36.462318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:36.463540 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-54c0abd1-c1be-400d-ab3e-00f62f4609a4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.184868 Jun 23 08:25:36.464099 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 347/675] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:36 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:36.756284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0619239e-58b5-4b93-8815-73e52a1b3e16 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:36.757483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0619239e-58b5-4b93-8815-73e52a1b3e16 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:36.769458 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0619239e-58b5-4b93-8815-73e52a1b3e16 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:36.770206 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0619239e-58b5-4b93-8815-73e52a1b3e16 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:36.771567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0619239e-58b5-4b93-8815-73e52a1b3e16 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:36.772285 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0619239e-58b5-4b93-8815-73e52a1b3e16 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:36.801092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7e49ea5f-609e-4f02-9568-d80db85c0609 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:36.801806 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7e49ea5f-609e-4f02-9568-d80db85c0609 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:36.808512 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7e49ea5f-609e-4f02-9568-d80db85c0609 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:36.808955 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7e49ea5f-609e-4f02-9568-d80db85c0609 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:36.809723 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7e49ea5f-609e-4f02-9568-d80db85c0609 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:36.810154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7e49ea5f-609e-4f02-9568-d80db85c0609 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:36.909391 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0619239e-58b5-4b93-8815-73e52a1b3e16 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:36.917168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0619239e-58b5-4b93-8815-73e52a1b3e16 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.167813 Jun 23 08:25:36.917919 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 329/676] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:36 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:36.944949 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7e49ea5f-609e-4f02-9568-d80db85c0609 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:36.952702 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7e49ea5f-609e-4f02-9568-d80db85c0609 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1514 microversion: 2.1 time: 0.155729 Jun 23 08:25:36.953310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 348/677] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:36 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:37.486538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:37.487844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:37.498443 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:37.499168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:37.500455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:37.501157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:37.640030 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:37.648086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:37.649580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:37.650726 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e7f90dd2-816c-47e1-a0af-2ade90f84adc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1721 microversion: 2.20 time: 0.171198 Jun 23 08:25:37.651418 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 330/678] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:37 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:37.937497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b4ad4b54-3948-4446-bef1-d58f0d9c140b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:37.938129 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b4ad4b54-3948-4446-bef1-d58f0d9c140b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:37.946281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b4ad4b54-3948-4446-bef1-d58f0d9c140b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:37.946815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b4ad4b54-3948-4446-bef1-d58f0d9c140b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:37.947779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b4ad4b54-3948-4446-bef1-d58f0d9c140b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:37.948292 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b4ad4b54-3948-4446-bef1-d58f0d9c140b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:37.970265 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4a822eab-9d2d-4c06-be37-af895f9e2ae0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:37.970980 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4a822eab-9d2d-4c06-be37-af895f9e2ae0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:37.977930 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a822eab-9d2d-4c06-be37-af895f9e2ae0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:37.978363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a822eab-9d2d-4c06-be37-af895f9e2ae0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:37.979109 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a822eab-9d2d-4c06-be37-af895f9e2ae0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:37.979565 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4a822eab-9d2d-4c06-be37-af895f9e2ae0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:38.081379 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b4ad4b54-3948-4446-bef1-d58f0d9c140b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:38.088952 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b4ad4b54-3948-4446-bef1-d58f0d9c140b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.157622 Jun 23 08:25:38.089525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 349/679] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:37 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:38.112641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4a822eab-9d2d-4c06-be37-af895f9e2ae0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:38.120549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4a822eab-9d2d-4c06-be37-af895f9e2ae0 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1514 microversion: 2.1 time: 0.154157 Jun 23 08:25:38.121146 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 331/680] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:37 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:38.670118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:38.670118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:38.676893 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:38.677569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:38.678348 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:38.678784 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:38.834754 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:38.843279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:38.845803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:38.847069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-db058d4a-0468-4933-b9c6-1bc2a5154062 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1724 microversion: 2.20 time: 0.181699 Jun 23 08:25:38.847859 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 350/681] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:38 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:38.866073 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-971b93b6-7e8e-4ca3-938a-1ee163f50723 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8194cfe-bf63-4b3f-8c75-3326a691f4f9"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:38.867253 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-971b93b6-7e8e-4ca3-938a-1ee163f50723 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:38.873906 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-971b93b6-7e8e-4ca3-938a-1ee163f50723 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:38.874346 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-971b93b6-7e8e-4ca3-938a-1ee163f50723 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:38.875141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-971b93b6-7e8e-4ca3-938a-1ee163f50723 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:38.875577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-971b93b6-7e8e-4ca3-938a-1ee163f50723 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.081075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:39.108392 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e5fd28ee-9ed2-4216-89e1-804339c2d187 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:39.109189 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e5fd28ee-9ed2-4216-89e1-804339c2d187 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:39.117032 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e5fd28ee-9ed2-4216-89e1-804339c2d187 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.117649 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e5fd28ee-9ed2-4216-89e1-804339c2d187 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.118619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e5fd28ee-9ed2-4216-89e1-804339c2d187 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.119048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e5fd28ee-9ed2-4216-89e1-804339c2d187 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.212645 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-971b93b6-7e8e-4ca3-938a-1ee163f50723 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.350787 Jun 23 08:25:39.213955 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 332/682] 10.222.0.33 () {62 vars in 1363 bytes} [Thu Jun 23 08:25:38 2022] POST /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments => generated 188 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 08:25:39.223442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2c9b5aa8-3f21-4dc8-9638-2e57ccbf99d3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:39.224176 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2c9b5aa8-3f21-4dc8-9638-2e57ccbf99d3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:39.230842 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2c9b5aa8-3f21-4dc8-9638-2e57ccbf99d3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.231389 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2c9b5aa8-3f21-4dc8-9638-2e57ccbf99d3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.232656 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2c9b5aa8-3f21-4dc8-9638-2e57ccbf99d3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.233315 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2c9b5aa8-3f21-4dc8-9638-2e57ccbf99d3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.295324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e5fd28ee-9ed2-4216-89e1-804339c2d187 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:39.303735 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e5fd28ee-9ed2-4216-89e1-804339c2d187 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.200984 Jun 23 08:25:39.304765 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 351/683] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:39 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:25:39.370307 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-360a9a89-957f-4961-a641-e946cfbc2a69 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:39.370882 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-360a9a89-957f-4961-a641-e946cfbc2a69 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:39.378061 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-360a9a89-957f-4961-a641-e946cfbc2a69 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.378547 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-360a9a89-957f-4961-a641-e946cfbc2a69 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.379357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-360a9a89-957f-4961-a641-e946cfbc2a69 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.379765 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-360a9a89-957f-4961-a641-e946cfbc2a69 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.531779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-360a9a89-957f-4961-a641-e946cfbc2a69 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/action" status: 202 len: 0 microversion: 2.20 time: 0.165514 Jun 23 08:25:39.532610 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 352/684] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 23 08:25:39 2022] POST /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:25:39.540571 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:39.541174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:39.547680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.548321 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.549375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.550073 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.611432 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2c9b5aa8-3f21-4dc8-9638-2e57ccbf99d3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:39.621382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2c9b5aa8-3f21-4dc8-9638-2e57ccbf99d3 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1514 microversion: 2.1 time: 0.406029 Jun 23 08:25:39.622512 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 333/685] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:39 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:39.697881 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:39.708891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:39.710839 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:39.712078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-82120dae-3753-4d75-89e9-3b0ccd00c2ae tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1750 microversion: 2.20 time: 0.175308 Jun 23 08:25:39.715735 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 353/686] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:39 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:25:39.919369 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-b35b92c4-e482-4fa1-afc6-4dfc1539638b req-69076f92-45c7-485f-aa7e-df2612298354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8146718e-1357-4016-ade0-b8c505398786", "name": "network-vif-deleted", "tag": "e195414b-7b53-40b2-90a6-297f183a70d4"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:39.927714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-b35b92c4-e482-4fa1-afc6-4dfc1539638b req-69076f92-45c7-485f-aa7e-df2612298354 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:39.928151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-b35b92c4-e482-4fa1-afc6-4dfc1539638b req-69076f92-45c7-485f-aa7e-df2612298354 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:39.940008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-b35b92c4-e482-4fa1-afc6-4dfc1539638b req-69076f92-45c7-485f-aa7e-df2612298354 service nova] Creating event network-vif-deleted:e195414b-7b53-40b2-90a6-297f183a70d4 for instance 8146718e-1357-4016-ade0-b8c505398786 on hv-cinder-84721 Jun 23 08:25:39.945171 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-b35b92c4-e482-4fa1-afc6-4dfc1539638b req-69076f92-45c7-485f-aa7e-df2612298354 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029684 Jun 23 08:25:39.945785 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 334/687] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:25:40.321206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ce4a3e6e-0ef5-4053-a18c-c8d39cc42837 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:40.321816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ce4a3e6e-0ef5-4053-a18c-c8d39cc42837 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:40.329059 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ce4a3e6e-0ef5-4053-a18c-c8d39cc42837 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:40.329510 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ce4a3e6e-0ef5-4053-a18c-c8d39cc42837 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:40.330280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ce4a3e6e-0ef5-4053-a18c-c8d39cc42837 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:40.330712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ce4a3e6e-0ef5-4053-a18c-c8d39cc42837 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:40.466730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ce4a3e6e-0ef5-4053-a18c-c8d39cc42837 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:40.477218 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ce4a3e6e-0ef5-4053-a18c-c8d39cc42837 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.160010 Jun 23 08:25:40.478243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 354/688] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:40 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:40.642529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a9e22962-510c-4b12-8407-1df644c5c081 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:40.643230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a9e22962-510c-4b12-8407-1df644c5c081 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:40.650642 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a9e22962-510c-4b12-8407-1df644c5c081 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:40.651119 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a9e22962-510c-4b12-8407-1df644c5c081 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:40.652167 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a9e22962-510c-4b12-8407-1df644c5c081 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:40.652683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a9e22962-510c-4b12-8407-1df644c5c081 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:40.720659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a9e22962-510c-4b12-8407-1df644c5c081 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:40.729715 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a9e22962-510c-4b12-8407-1df644c5c081 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1472 microversion: 2.1 time: 0.092965 Jun 23 08:25:40.730532 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:40.730663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 335/689] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:40 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:40.731167 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:40.738141 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:40.738589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:40.739398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:40.739830 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:40.875887 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:40.889379 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:40.891632 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:40.893511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-76790248-2b68-4696-808a-a0c9772d1669 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1750 microversion: 2.20 time: 0.166420 Jun 23 08:25:40.894125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 355/690] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:40 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:41.497930 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ee38fb6d-8ae3-41a2-b86f-0821cbe5e814 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:41.498970 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ee38fb6d-8ae3-41a2-b86f-0821cbe5e814 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:41.505354 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ee38fb6d-8ae3-41a2-b86f-0821cbe5e814 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:41.505806 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ee38fb6d-8ae3-41a2-b86f-0821cbe5e814 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:41.506599 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ee38fb6d-8ae3-41a2-b86f-0821cbe5e814 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:41.507034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ee38fb6d-8ae3-41a2-b86f-0821cbe5e814 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:41.644441 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ee38fb6d-8ae3-41a2-b86f-0821cbe5e814 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:41.652415 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ee38fb6d-8ae3-41a2-b86f-0821cbe5e814 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.161102 Jun 23 08:25:41.652982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 336/691] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:41 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:41.750639 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-52fe7835-43a0-4629-a0d5-af3d5b13fee1 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:41.751238 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-52fe7835-43a0-4629-a0d5-af3d5b13fee1 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:41.758195 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-52fe7835-43a0-4629-a0d5-af3d5b13fee1 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:41.758637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-52fe7835-43a0-4629-a0d5-af3d5b13fee1 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:41.759455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-52fe7835-43a0-4629-a0d5-af3d5b13fee1 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:41.759876 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-52fe7835-43a0-4629-a0d5-af3d5b13fee1 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:41.823044 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-52fe7835-43a0-4629-a0d5-af3d5b13fee1 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:41.831318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-52fe7835-43a0-4629-a0d5-af3d5b13fee1 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1472 microversion: 2.1 time: 0.086649 Jun 23 08:25:41.831882 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 356/692] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:41 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:41.916671 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:41.917270 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:41.923932 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:41.924373 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:41.925131 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:41.925559 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:42.069876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:42.078733 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:42.080257 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:42.081405 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f8245db4-5167-4aa9-bcf4-ebe8ffdce51f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1750 microversion: 2.20 time: 0.168691 Jun 23 08:25:42.081951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 337/693] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:41 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:42.670349 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5f523786-ec05-4db2-add0-9a50a3512e85 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:42.671431 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5f523786-ec05-4db2-add0-9a50a3512e85 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:42.678338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5f523786-ec05-4db2-add0-9a50a3512e85 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:42.678784 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5f523786-ec05-4db2-add0-9a50a3512e85 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:42.679579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5f523786-ec05-4db2-add0-9a50a3512e85 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:42.680051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5f523786-ec05-4db2-add0-9a50a3512e85 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:42.813393 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5f523786-ec05-4db2-add0-9a50a3512e85 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:42.820743 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5f523786-ec05-4db2-add0-9a50a3512e85 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.154986 Jun 23 08:25:42.821308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 357/694] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:42 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:42.849843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:42.850813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:42.859852 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:42.860301 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:42.861062 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:42.861507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:42.894168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:42.894695 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:42.895116 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lazy-loading 'fault' on Instance uuid 8146718e-1357-4016-ade0-b8c505398786 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:25:42.964360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b66024bd78487082154441343a2161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8f88d81c04623b66edaf1cebc2ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:42.972868 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ae426253-712c-44e4-b5a5-75f270071f60 tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 200 len: 1309 microversion: 2.1 time: 0.128176 Jun 23 08:25:42.973555 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 338/695] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:42 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:43.100113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:43.100725 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:43.106895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:43.107578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:43.108663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:43.109094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:43.248862 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:43.257783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:43.259240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:43.260411 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6eba2a6e-5fc1-43d2-9438-fc3319d88cd8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1752 microversion: 2.20 time: 0.164516 Jun 23 08:25:43.260930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 358/696] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:43 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:25:43.838670 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0d501f26-fb06-4b89-bc1a-0816348c3916 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:43.839738 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0d501f26-fb06-4b89-bc1a-0816348c3916 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:43.847139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d501f26-fb06-4b89-bc1a-0816348c3916 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:43.848086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d501f26-fb06-4b89-bc1a-0816348c3916 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:43.848890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d501f26-fb06-4b89-bc1a-0816348c3916 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:43.849887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d501f26-fb06-4b89-bc1a-0816348c3916 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:43.991375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:43.992117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] [instance: 8146718e-1357-4016-ade0-b8c505398786] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:43.996778 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0d501f26-fb06-4b89-bc1a-0816348c3916 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:43.999812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:44.000313 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:44.001146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:44.001632 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:44.004812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0d501f26-fb06-4b89-bc1a-0816348c3916 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.170884 Jun 23 08:25:44.005759 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 339/697] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:43 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:44.016129 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] HTTP exception thrown: Instance 8146718e-1357-4016-ade0-b8c505398786 could not be found. Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Request method failure captured: Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 HTTP/1.1 Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCKHCl_tlzvpxQ-j5SkJjwHd4AihU4ERmVLFUYXpU-ESLalTF0vP_hDPlydfdIQAyGGVybM0O9b2uDpQPCszxhGcYLZVzVzgZWZxnX5UtQaQWi_djtUxWZ51Ek28tDbm085YO5pHweu3RF1SJRKLJu-dMGn6hNobBVJtZF6EDtOMMD4 Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: bea8f88d81c04623b66edaf1cebc2ee3 Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1211208290 Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:25:44.017768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bea8f88d81c04623b66edaf1cebc2ee3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bea8f88d81c04623b66edaf1cebc2ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bea8f88d81c04623b66edaf1cebc2ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bea8f88d81c04623b66edaf1cebc2ee3"}]}] Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesSnapshotTestJSON-1211208290 Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: bea8f88d81c04623b66edaf1cebc2ee3 Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1211208290 Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesSnapshotTestJSON-1211208290-project Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 44b66024bd78487082154441343a2161 Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesSnapshotTestJSON-1211208290-project Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 8146718e-1357-4016-ade0-b8c505398786 could not be found. Jun 23 08:25:44.019421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '8146718e-1357-4016-ade0-b8c505398786'} Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8146718e-1357-4016-ade0-b8c505398786 could not be found. Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:25:44.020308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8146718e-1357-4016-ade0-b8c505398786 could not be found. Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8146718e-1357-4016-ade0-b8c505398786 could not be found. Jun 23 08:25:44.021802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:25:44.023120 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] Returning 404 to user: Instance 8146718e-1357-4016-ade0-b8c505398786 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:25:44.023120 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-eaea52c2-5466-4ddc-9300-ad5c52c51aef tempest-VolumesSnapshotTestJSON-1211208290 tempest-VolumesSnapshotTestJSON-1211208290-project] 10.222.0.33 "GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786" status: 404 len: 111 microversion: 2.1 time: 0.031799 Jun 23 08:25:44.023120 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 359/698] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:43 2022] GET /compute/v2.1/servers/8146718e-1357-4016-ade0-b8c505398786 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:25:44.278370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:44.279106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:44.292810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:44.293614 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:44.294469 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:44.294963 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:44.442074 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:44.450887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:44.452771 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:44.453693 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-fe2609ea-d029-48e0-8477-42698e376287 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1752 microversion: 2.20 time: 0.179513 Jun 23 08:25:44.454247 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 340/699] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:44 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:44.767655 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-9c801609-e203-4779-ae52-c167fdd16acc req-a6f4ac36-f4c9-4e7b-a853-3f9d0ffdb0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3ae113-1126-44da-8b3a-42e7f777a8c7", "name": "network-vif-plugged", "status": "completed", "tag": "45988a1f-4c36-4aab-9724-eb0b20919aef"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:44.778720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-9c801609-e203-4779-ae52-c167fdd16acc req-a6f4ac36-f4c9-4e7b-a853-3f9d0ffdb0c6 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:44.779149 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-9c801609-e203-4779-ae52-c167fdd16acc req-a6f4ac36-f4c9-4e7b-a853-3f9d0ffdb0c6 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:44.793818 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-9c801609-e203-4779-ae52-c167fdd16acc req-a6f4ac36-f4c9-4e7b-a853-3f9d0ffdb0c6 service nova] Creating event network-vif-plugged:45988a1f-4c36-4aab-9724-eb0b20919aef for instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 on hv-cinder-84721 Jun 23 08:25:44.799184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-9c801609-e203-4779-ae52-c167fdd16acc req-a6f4ac36-f4c9-4e7b-a853-3f9d0ffdb0c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035364 Jun 23 08:25:44.799827 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 360/700] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:25:45.022242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-832c3acc-1351-4f52-93f7-79126464fb81 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:45.022882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-832c3acc-1351-4f52-93f7-79126464fb81 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:45.029769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-832c3acc-1351-4f52-93f7-79126464fb81 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:45.030232 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-832c3acc-1351-4f52-93f7-79126464fb81 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:45.030979 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-832c3acc-1351-4f52-93f7-79126464fb81 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:45.031426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-832c3acc-1351-4f52-93f7-79126464fb81 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:45.309221 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-832c3acc-1351-4f52-93f7-79126464fb81 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:45.317790 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-832c3acc-1351-4f52-93f7-79126464fb81 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.299407 Jun 23 08:25:45.318341 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 341/701] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:45 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:45.473948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:45.474610 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:45.482143 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:45.482573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:45.483717 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:45.484161 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:45.647717 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:45.656513 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:45.658022 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:45.659173 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0a8c85a7-8541-44af-831d-0dc07d1b3e6c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.190006 Jun 23 08:25:45.659786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 361/702] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:45 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:46.335762 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3944a003-9288-4a80-8567-20af2130a689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:46.336473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3944a003-9288-4a80-8567-20af2130a689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:46.343926 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3944a003-9288-4a80-8567-20af2130a689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:46.344371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3944a003-9288-4a80-8567-20af2130a689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:46.345133 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3944a003-9288-4a80-8567-20af2130a689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:46.345810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3944a003-9288-4a80-8567-20af2130a689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:46.484323 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3944a003-9288-4a80-8567-20af2130a689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:46.492311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3944a003-9288-4a80-8567-20af2130a689 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.160724 Jun 23 08:25:46.492857 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 342/703] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:46 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:46.679367 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:46.680183 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:46.688710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:46.689350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:46.690119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:46.690549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:46.828880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:46.838695 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:46.840254 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:46.841488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-077e227e-5a77-425c-a04c-7e200f19a0bd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.166358 Jun 23 08:25:46.841997 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 362/704] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:46 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:47.510045 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9c5b6fc8-5c19-4426-ad7d-d173163d6ff3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:47.510677 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9c5b6fc8-5c19-4426-ad7d-d173163d6ff3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:47.517387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c5b6fc8-5c19-4426-ad7d-d173163d6ff3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:47.517836 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c5b6fc8-5c19-4426-ad7d-d173163d6ff3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:47.518621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c5b6fc8-5c19-4426-ad7d-d173163d6ff3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:47.519134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c5b6fc8-5c19-4426-ad7d-d173163d6ff3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:47.657602 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9c5b6fc8-5c19-4426-ad7d-d173163d6ff3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:47.665415 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9c5b6fc8-5c19-4426-ad7d-d173163d6ff3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.159212 Jun 23 08:25:47.665976 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 343/705] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:47 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:47.859789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:47.860377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:47.867622 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:47.868258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:47.869036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:47.869467 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:48.000537 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:48.014633 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:48.017084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:48.018552 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f9cc9e8d-6b29-4194-81c6-4d243fd6a982 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.162771 Jun 23 08:25:48.019110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 363/706] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:47 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:48.681828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f4dc1d96-d4a5-424b-a613-3692d6186d3e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:48.682426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f4dc1d96-d4a5-424b-a613-3692d6186d3e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:48.689352 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f4dc1d96-d4a5-424b-a613-3692d6186d3e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:48.689951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f4dc1d96-d4a5-424b-a613-3692d6186d3e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:48.690718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f4dc1d96-d4a5-424b-a613-3692d6186d3e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:48.691151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f4dc1d96-d4a5-424b-a613-3692d6186d3e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:48.822493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f4dc1d96-d4a5-424b-a613-3692d6186d3e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:48.831793 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f4dc1d96-d4a5-424b-a613-3692d6186d3e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.153580 Jun 23 08:25:48.832350 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 344/707] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:48 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:49.041059 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:49.041896 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:49.045729 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:49.054492 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:49.055311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:49.056593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:49.057399 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:49.080172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:49.206995 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:49.216104 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:49.217596 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:49.218744 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-da27242c-0538-408a-ae0e-edf9fce3018b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.184304 Jun 23 08:25:49.219315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 364/708] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:49 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:49.849342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7d973ec7-81a4-4f31-89c9-44b8b12056e2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:49.849942 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7d973ec7-81a4-4f31-89c9-44b8b12056e2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:49.856941 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d973ec7-81a4-4f31-89c9-44b8b12056e2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:49.857431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d973ec7-81a4-4f31-89c9-44b8b12056e2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:49.858254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d973ec7-81a4-4f31-89c9-44b8b12056e2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:49.858681 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d973ec7-81a4-4f31-89c9-44b8b12056e2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:50.001998 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7d973ec7-81a4-4f31-89c9-44b8b12056e2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:50.010119 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7d973ec7-81a4-4f31-89c9-44b8b12056e2 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.164812 Jun 23 08:25:50.010727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 345/709] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:49 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:50.240500 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:50.241170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:50.249619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:50.250144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:50.251032 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:50.251575 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:50.396542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:50.406069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:50.407702 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:50.409531 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4cfe7a2c-708e-4ef6-8634-f9b3ea460c25 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.174399 Jun 23 08:25:50.410102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 365/710] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:50 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:51.030012 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7f1f6c82-99dc-469f-ac87-05d049203ab4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:51.030760 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7f1f6c82-99dc-469f-ac87-05d049203ab4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:51.037531 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7f1f6c82-99dc-469f-ac87-05d049203ab4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:51.038192 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7f1f6c82-99dc-469f-ac87-05d049203ab4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:51.038962 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7f1f6c82-99dc-469f-ac87-05d049203ab4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:51.040044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7f1f6c82-99dc-469f-ac87-05d049203ab4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:51.171176 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7f1f6c82-99dc-469f-ac87-05d049203ab4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:51.179382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7f1f6c82-99dc-469f-ac87-05d049203ab4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1358 microversion: 2.1 time: 0.153188 Jun 23 08:25:51.181101 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 346/711] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:51 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:51.431427 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:51.432311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:51.443011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:51.443489 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:51.444220 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:51.444645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:51.592752 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:51.601746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:51.603252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:51.604410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f6eea2e8-02ab-463d-8147-8071f3c0bcbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.179139 Jun 23 08:25:51.604957 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 366/712] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:51 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:52.210171 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b6b3c3da-f855-4bc0-af5e-e265e67183c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:52.210835 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b6b3c3da-f855-4bc0-af5e-e265e67183c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:52.218509 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b6b3c3da-f855-4bc0-af5e-e265e67183c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:52.218956 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b6b3c3da-f855-4bc0-af5e-e265e67183c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:52.219769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b6b3c3da-f855-4bc0-af5e-e265e67183c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:52.245530 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b6b3c3da-f855-4bc0-af5e-e265e67183c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:52.481292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b6b3c3da-f855-4bc0-af5e-e265e67183c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:52.491381 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b6b3c3da-f855-4bc0-af5e-e265e67183c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1546 microversion: 2.1 time: 0.297194 Jun 23 08:25:52.492447 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 347/713] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:52 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1546 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:52.522725 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-318d37d8-ab08-4eee-8421-a077979727b3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:52.523410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-318d37d8-ab08-4eee-8421-a077979727b3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:52.533950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-318d37d8-ab08-4eee-8421-a077979727b3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:52.534692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-318d37d8-ab08-4eee-8421-a077979727b3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:52.535674 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-318d37d8-ab08-4eee-8421-a077979727b3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:52.536262 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-318d37d8-ab08-4eee-8421-a077979727b3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:52.622814 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:52.623477 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:52.639010 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:52.639490 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:52.640269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:52.640742 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:52.658426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:25:52.722730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-318d37d8-ab08-4eee-8421-a077979727b3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:52.739732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-318d37d8-ab08-4eee-8421-a077979727b3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1546 microversion: 2.1 time: 0.234378 Jun 23 08:25:52.740290 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 367/714] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:52 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1546 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:52.761783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:52.765156 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:52.765924 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Searching by: {'deleted': False, 'project_id': '796208f488e742d1beaef6d02f0232e6'} {{(pid=117758) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 08:25:52.773150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:52.773623 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:52.774782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:52.775201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:52.794025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:52.802753 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:52.804373 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:52.805436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-50d6f9b3-0e9c-4cfc-b957-3e02d08c68e2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.186919 Jun 23 08:25:52.806178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 348/715] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:52 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:52.885024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.multi_cell_list [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117758) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 08:25:52.995545 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-dc84bf79-a183-4de8-bcc8-e07a2283b8bf tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.236972 Jun 23 08:25:52.996184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 368/716] 10.222.0.33 () {58 vars in 1124 bytes} [Thu Jun 23 08:25:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:25:53.006779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d70ee411-8c79-47dd-a10b-f7027522fe69 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:53.007418 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d70ee411-8c79-47dd-a10b-f7027522fe69 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:53.013734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d70ee411-8c79-47dd-a10b-f7027522fe69 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:53.014173 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d70ee411-8c79-47dd-a10b-f7027522fe69 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:53.015137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d70ee411-8c79-47dd-a10b-f7027522fe69 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:53.015592 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d70ee411-8c79-47dd-a10b-f7027522fe69 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:53.164094 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d70ee411-8c79-47dd-a10b-f7027522fe69 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:53.171707 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d70ee411-8c79-47dd-a10b-f7027522fe69 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1546 microversion: 2.1 time: 0.168786 Jun 23 08:25:53.172294 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 349/717] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:25:53 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:25:53.825158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:53.826253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:53.837162 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:53.837639 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:53.838480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:53.839047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:53.981211 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:53.993537 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:53.995522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:53.996905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-50810d70-db36-49ba-a54c-df1e609cc365 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.176497 Jun 23 08:25:53.997466 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 369/718] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:53 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:25:55.016999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:55.017663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:55.024340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:55.024780 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:55.025543 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:55.026029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:55.428302 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:55.436861 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:55.438327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:55.439498 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e87f8044-db25-4146-ab56-b148b0414177 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.426864 Jun 23 08:25:55.440147 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 350/719] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:55 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:55.813033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0c685239-0036-412c-b5ae-ac1906888d7c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7171da4-4237-447f-ba6b-2b082906e3d4"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:25:55.814099 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0c685239-0036-412c-b5ae-ac1906888d7c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:55.821150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c685239-0036-412c-b5ae-ac1906888d7c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:55.821605 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c685239-0036-412c-b5ae-ac1906888d7c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:55.822356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c685239-0036-412c-b5ae-ac1906888d7c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:55.822786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c685239-0036-412c-b5ae-ac1906888d7c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:56.460850 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:56.462423 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:56.469693 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:56.470138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:56.471698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:56.472157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:56.608907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:56.617731 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:56.619264 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:56.620759 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7d827816-80e5-49e8-b3c2-fe3979089755 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.166051 Jun 23 08:25:56.621326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 351/720] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:56 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:57.639635 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:57.640413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:57.647546 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:57.647992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:57.648783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:57.649211 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:57.794021 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:57.802885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:57.804425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:57.805624 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5ddd93ee-9a71-44ff-8c6c-0b01d84b8bbf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.170032 Jun 23 08:25:57.806168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 352/721] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:57 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:25:58.827014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:25:58.827765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:25:58.836714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:58.837169 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:58.837963 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:25:58.838404 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:25:58.986496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:58.996676 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:58.998191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:25:58.999421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6375b935-21a9-45c0-8a97-8c2909e7d9ed tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.178902 Jun 23 08:25:58.999989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 353/722] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:25:58 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:26:00.018182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:00.018920 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:00.025598 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:00.026038 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:00.026794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:00.027409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:00.168885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:00.179483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:00.179898 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:00.181181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-63b3297a-2321-4462-a5a4-e15824723791 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.166958 Jun 23 08:26:00.190040 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 354/723] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:00 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:26:01.202507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:01.204030 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:01.214254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:01.214703 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:01.215501 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:01.215917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:01.369093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:01.378288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:01.379819 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:01.381166 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6d19111a-7132-45df-82db-1ec210e848a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.184677 Jun 23 08:26:01.381830 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 355/724] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:01 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:02.400055 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:02.400828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:02.404933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=68 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:02.409174 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:02.409634 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:02.410400 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:02.410833 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:02.562254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:02.575595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:02.577530 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:02.579106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1244e727-358e-4117-97db-7ac425006b2f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.183114 Jun 23 08:26:02.579846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 356/725] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:02 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:26:02.806482 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:03.598807 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:03.599493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:03.606774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:03.607243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:03.608019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:03.608450 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:03.775556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:03.784492 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:03.785980 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:03.787201 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-02718707-9c34-4850-8443-0f1b371f8edb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.192540 Jun 23 08:26:03.787836 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 357/726] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:03 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:04.806663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:04.807515 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:04.815241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:04.815760 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:04.816601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:04.817082 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:04.956659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:04.965385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:04.966855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:04.968048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-92f40736-3448-4b71-8a3e-fc90321700a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.165847 Jun 23 08:26:04.968609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 358/727] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:04 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:05.818280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=13 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:05.912026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=40 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:05.986328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:05.986953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:05.994115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:05.994871 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:05.995659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:05.996086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:06.135659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:06.144336 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:06.145910 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:06.147156 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ef3ea178-f0d0-4618-933a-d1f8414d8688 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.164928 Jun 23 08:26:06.148174 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 359/728] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:05 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:26:07.165758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:07.166549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:07.179399 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:07.179894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:07.180684 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:07.181110 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:07.327559 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:07.336906 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:07.338808 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:07.339970 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-33c7c4e0-bbe5-4eb6-a5df-b63673da923b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.178200 Jun 23 08:26:07.340717 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 360/729] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:07 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:08.359913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:08.360576 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:08.367806 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:08.368244 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:08.370353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:08.370353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:08.506077 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:08.514887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:08.516408 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:08.517550 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-29b27ed5-c9e8-46cc-ba0c-68bb531f5204 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.161708 Jun 23 08:26:08.518094 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 361/730] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:08 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:09.536040 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:09.536680 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:09.543758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:09.544224 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:09.544976 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:09.545387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:09.686541 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:09.695660 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:09.697148 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:09.698321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d91f1b6a-2209-43e2-9fc5-ef8d378e49b1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.166352 Jun 23 08:26:09.699184 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 362/731] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:09 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:10.717870 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:10.718651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:10.725313 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:10.725779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:10.726555 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:10.726981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:10.867271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:10.876694 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:10.878167 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:10.879346 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6a452985-58be-4e3c-81b3-c599dbd57794 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.165650 Jun 23 08:26:10.879893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 363/732] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:10 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:26:11.897681 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:11.898326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:11.905616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:11.906078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:11.906873 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:11.907323 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:11.972673 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0c685239-0036-412c-b5ae-ac1906888d7c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "POST /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.163428 Jun 23 08:26:11.973480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 370/733] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:25:55 2022] POST /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 194 bytes in 16165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:26:12.053348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:12.062122 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:12.063631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:12.064791 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0c198c41-7177-4b3e-ad44-c118410a2938 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.171071 Jun 23 08:26:12.065360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 364/734] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:11 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:13.088935 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:13.088935 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:13.093096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:13.093535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:13.094308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:13.094733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:13.227974 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:13.236572 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:13.238074 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:13.239234 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1057d40f-4130-4e01-b5f4-9d6237a639b6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.159223 Jun 23 08:26:13.239838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 371/735] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:13 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:14.260875 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:14.261922 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:14.271324 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:14.271929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:14.272886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:14.273483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:14.277368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:14.420132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:14.429080 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:14.430524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:14.431737 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-06c8924c-3219-4f25-84ad-a30b0b74d394 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.176663 Jun 23 08:26:14.432300 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 365/736] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:14 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:15.450160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:15.450745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:15.460144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:15.460569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:15.461415 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:15.461870 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:15.598130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:15.607369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:15.609476 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:15.610646 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2d15232c-d09c-4747-9297-aa7b0f495720 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.164472 Jun 23 08:26:15.611421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 372/737] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:15 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:16.629883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:16.630518 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:16.639454 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:16.640063 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:16.641600 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:16.641729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:16.826743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:16.836050 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:16.837647 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:16.838876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-690dd68f-0d28-430d-b833-3d6ef15235e9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.213157 Jun 23 08:26:16.839473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 366/738] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:16 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:17.859846 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:17.861325 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:17.868378 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:17.868822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:17.869920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:17.870349 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:18.017065 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:18.028026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:18.033730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:18.035787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7cb69f83-7611-4177-8e3d-9900ed872f7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.181044 Jun 23 08:26:18.047130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 373/739] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:17 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:19.053973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:19.054584 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:19.061540 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:19.061975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:19.062698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:19.063431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:19.286994 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:19.297062 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:19.298710 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:19.300036 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-61a72dad-2fa4-45e0-bc3b-eb69c991fb80 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.250019 Jun 23 08:26:19.311152 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 367/740] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:19 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:20.320710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:20.322062 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:20.330560 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:20.331371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:20.332346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:20.332979 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:20.499302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:20.512704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:20.516895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:20.518712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b1eda3b5-f1ac-442e-abe1-1b80b152d99b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.202766 Jun 23 08:26:20.519566 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 374/741] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:20 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:21.551270 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:21.551877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:21.559394 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:21.559862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:21.561053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:21.561322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:21.746083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:21.758053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:21.760163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:21.762355 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9b382f60-ba4b-479c-b63f-d6af372c3387 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.217735 Jun 23 08:26:21.763125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 368/742] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:21 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:21.812546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-67c6f0b2-b0e9-4050-8c15-83e3bf7ea084 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:21.813423 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-67c6f0b2-b0e9-4050-8c15-83e3bf7ea084 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:21.822388 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-67c6f0b2-b0e9-4050-8c15-83e3bf7ea084 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:21.828621 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-67c6f0b2-b0e9-4050-8c15-83e3bf7ea084 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:21.830096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-67c6f0b2-b0e9-4050-8c15-83e3bf7ea084 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:21.834010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-67c6f0b2-b0e9-4050-8c15-83e3bf7ea084 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:22.109897 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-67c6f0b2-b0e9-4050-8c15-83e3bf7ea084 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:22.119982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-67c6f0b2-b0e9-4050-8c15-83e3bf7ea084 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1592 microversion: 2.1 time: 0.311631 Jun 23 08:26:22.121338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 375/743] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:21 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1592 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:22.785673 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:22.786408 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:22.795804 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:22.796710 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:22.797698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:22.798313 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:23.014226 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:23.029918 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:23.033841 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:23.035698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-be9a3d22-7d4c-4e44-97c7-1ee105590b27 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.257298 Jun 23 08:26:23.051173 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 369/744] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:22 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:23.926637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-a79dd46f-59ec-4d0a-bfc1-688c65bde477 req-7641d05a-33a6-4a2c-af83-5da3e476e6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62a72a3-1376-4284-94a0-d57fbe81f1b9", "name": "network-vif-plugged", "status": "completed", "tag": "95dc486f-023d-4b75-87c7-155fbce47ca4"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:23.939240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-a79dd46f-59ec-4d0a-bfc1-688c65bde477 req-7641d05a-33a6-4a2c-af83-5da3e476e6f8 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:23.940066 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-a79dd46f-59ec-4d0a-bfc1-688c65bde477 req-7641d05a-33a6-4a2c-af83-5da3e476e6f8 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:24.003148 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-a79dd46f-59ec-4d0a-bfc1-688c65bde477 req-7641d05a-33a6-4a2c-af83-5da3e476e6f8 service nova] Creating event network-vif-plugged:95dc486f-023d-4b75-87c7-155fbce47ca4 for instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 on hv-cinder-84721 Jun 23 08:26:24.011138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-a79dd46f-59ec-4d0a-bfc1-688c65bde477 req-7641d05a-33a6-4a2c-af83-5da3e476e6f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357263 Jun 23 08:26:24.015737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 376/745] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:26:24.059200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:24.060491 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:24.069737 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:24.070176 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:24.075827 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:24.076475 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:24.458179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:24.472164 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:24.475886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:24.477372 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0fa13617-2794-4b8a-b601-05f10ec0b8cf tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.427219 Jun 23 08:26:24.479998 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 370/746] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:24 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:24.996596 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-256089e0-d78d-4e24-b498-4d03305f69cb req-86e56148-5bae-4618-b185-c8da68a06fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3ae113-1126-44da-8b3a-42e7f777a8c7", "tag": "45988a1f-4c36-4aab-9724-eb0b20919aef"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:25.025062 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-256089e0-d78d-4e24-b498-4d03305f69cb req-86e56148-5bae-4618-b185-c8da68a06fed service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:25.028559 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-256089e0-d78d-4e24-b498-4d03305f69cb req-86e56148-5bae-4618-b185-c8da68a06fed service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:25.046794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-256089e0-d78d-4e24-b498-4d03305f69cb req-86e56148-5bae-4618-b185-c8da68a06fed service nova] Creating event network-changed:45988a1f-4c36-4aab-9724-eb0b20919aef for instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 on hv-cinder-84721 Jun 23 08:26:25.074292 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-256089e0-d78d-4e24-b498-4d03305f69cb req-86e56148-5bae-4618-b185-c8da68a06fed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218297 Jun 23 08:26:25.075593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 377/747] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:26:25.506911 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:25.508291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:25.521417 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:25.522139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:25.524231 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:25.528029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:25.900910 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:25.917729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:25.917729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:25.917729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-459f775c-aa07-4567-95b6-53d0582f1116 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.414827 Jun 23 08:26:25.918320 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 371/748] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:25 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:26.941041 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:26.945670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:26.973361 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:26.976312 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:26.977150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:26.977593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:27.272196 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6e61bb13-d33e-4510-acd4-880ecd6ba127 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-815976990"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:27.274050 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6e61bb13-d33e-4510-acd4-880ecd6ba127 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:27.288905 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e61bb13-d33e-4510-acd4-880ecd6ba127 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:27.291056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e61bb13-d33e-4510-acd4-880ecd6ba127 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:27.295096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e61bb13-d33e-4510-acd4-880ecd6ba127 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:27.295509 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e61bb13-d33e-4510-acd4-880ecd6ba127 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:27.390526 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:27.418380 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:27.422295 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:27.424865 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4be975e3-5c2b-404a-8fce-4b0960613508 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1808 microversion: 2.20 time: 0.490517 Jun 23 08:26:27.443966 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 378/749] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:26 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1808 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:27.720568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.network.security_group_api [None req-6e61bb13-d33e-4510-acd4-880ecd6ba127 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Adding security group 0c560df2-acca-41e2-9d59-d7fe16f7c713 to port 45988a1f-4c36-4aab-9724-eb0b20919aef Jun 23 08:26:28.031099 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4212504e-4c56-4087-a733-2947da0d1609 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Action: 'create', calling method: .version_select at 0x7feb62fa7160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-5901677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOcRBz9LNnQo9DrbAhpjTWn0VdPXEOMsmDmAzhr7uj38VJapJsYQdYn2JXBq3T2/vW2iBRiBVlg3XW5fNs4bSzX2v/H8Fft1EJkkDHmUlSTvYxff0PsdFlu18txdN+1zQ=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:28.048785 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-4212504e-4c56-4087-a733-2947da0d1609 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Getting quotas for project aa6a422103704f6d982c2bc558b3387e. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:26:28.053396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-4212504e-4c56-4087-a733-2947da0d1609 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Getting quotas for user 8d661ea344d74681bb7206f203033c60 and project aa6a422103704f6d982c2bc558b3387e. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:26:28.086476 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4212504e-4c56-4087-a733-2947da0d1609 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.253969 Jun 23 08:26:28.087083 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 379/750] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:26:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:26:28.414792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6e61bb13-d33e-4510-acd4-880ecd6ba127 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "POST /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/action" status: 202 len: 0 microversion: 2.1 time: 1.151304 Jun 23 08:26:28.415796 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 372/751] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:26:27 2022] POST /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/action => generated 0 bytes in 1153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:26:28.430350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0787d4e7-5ef0-4c89-9509-ed2b6b16d58c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:28.434729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-c1560860-2380-4b0e-a34d-5f69b5c56972 req-bc20de46-f715-4952-be2d-e55b5d8501f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3ae113-1126-44da-8b3a-42e7f777a8c7", "tag": "45988a1f-4c36-4aab-9724-eb0b20919aef"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:28.435535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0787d4e7-5ef0-4c89-9509-ed2b6b16d58c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:28.454546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0787d4e7-5ef0-4c89-9509-ed2b6b16d58c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:28.457746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0787d4e7-5ef0-4c89-9509-ed2b6b16d58c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:28.459936 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0787d4e7-5ef0-4c89-9509-ed2b6b16d58c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:28.461208 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0787d4e7-5ef0-4c89-9509-ed2b6b16d58c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:28.465108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-c1560860-2380-4b0e-a34d-5f69b5c56972 req-bc20de46-f715-4952-be2d-e55b5d8501f3 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:28.465965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-c1560860-2380-4b0e-a34d-5f69b5c56972 req-bc20de46-f715-4952-be2d-e55b5d8501f3 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:28.499615 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-c1560860-2380-4b0e-a34d-5f69b5c56972 req-bc20de46-f715-4952-be2d-e55b5d8501f3 service nova] Creating event network-changed:45988a1f-4c36-4aab-9724-eb0b20919aef for instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 on hv-cinder-84721 Jun 23 08:26:28.510787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-c1560860-2380-4b0e-a34d-5f69b5c56972 req-bc20de46-f715-4952-be2d-e55b5d8501f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084690 Jun 23 08:26:28.511949 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 373/752] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:26:28.522975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:28.524298 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:28.535367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:28.536095 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:28.537098 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:28.538033 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:28.815673 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:28.834254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:28.840596 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:28.844585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-228a2f84-2c00-4d30-9565-860b1077cc51 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1795 microversion: 2.20 time: 0.331062 Jun 23 08:26:28.870160 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 374/753] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:26:28 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1795 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:26:29.133745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0787d4e7-5ef0-4c89-9509-ed2b6b16d58c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:29.150340 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0787d4e7-5ef0-4c89-9509-ed2b6b16d58c tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1756 microversion: 2.1 time: 0.726428 Jun 23 08:26:29.153612 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 380/754] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:28 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1756 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:41.354499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=37 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:41.355239 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=53 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:41.468185 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-56aaa305-e35d-485a-a98e-4fc77ec61c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4154c349-32e7-4bab-95ba-ab900ea72c6d"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:41.469301 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-56aaa305-e35d-485a-a98e-4fc77ec61c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:41.475990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-56aaa305-e35d-485a-a98e-4fc77ec61c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:41.476433 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-56aaa305-e35d-485a-a98e-4fc77ec61c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:41.477189 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-56aaa305-e35d-485a-a98e-4fc77ec61c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:41.477708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-56aaa305-e35d-485a-a98e-4fc77ec61c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:41.757709 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-56aaa305-e35d-485a-a98e-4fc77ec61c89 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408361 Jun 23 08:26:41.758356 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 375/755] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:26:41 2022] POST /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:26:50.384533 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b2bf1fe1-4229-433a-a85c-c9fe6d11776f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:50.385537 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b2bf1fe1-4229-433a-a85c-c9fe6d11776f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:50.388187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=4 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:50.388868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:50.389484 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:26:50.394892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2bf1fe1-4229-433a-a85c-c9fe6d11776f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:50.395375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2bf1fe1-4229-433a-a85c-c9fe6d11776f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:50.396137 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2bf1fe1-4229-433a-a85c-c9fe6d11776f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:50.396572 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b2bf1fe1-4229-433a-a85c-c9fe6d11776f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:50.421619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-b2bf1fe1-4229-433a-a85c-c9fe6d11776f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lazy-loading 'flavor' on Instance uuid fca4749e-9663-407f-a8fd-e58e91f7d55e {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:26:50.558654 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b2bf1fe1-4229-433a-a85c-c9fe6d11776f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/action" status: 200 len: 32 microversion: 2.1 time: 0.177592 Jun 23 08:26:50.559515 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 381/756] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:26:50 2022] POST /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:26:50.574970 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-50a79da8-83a2-4a31-a0ab-5075cf365f10 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:50.575677 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-50a79da8-83a2-4a31-a0ab-5075cf365f10 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:50.582117 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50a79da8-83a2-4a31-a0ab-5075cf365f10 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:50.582551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50a79da8-83a2-4a31-a0ab-5075cf365f10 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:50.583340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50a79da8-83a2-4a31-a0ab-5075cf365f10 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:50.583762 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50a79da8-83a2-4a31-a0ab-5075cf365f10 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:50.802397 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-50a79da8-83a2-4a31-a0ab-5075cf365f10 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:50.810789 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-50a79da8-83a2-4a31-a0ab-5075cf365f10 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.242873 Jun 23 08:26:50.811390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 376/757] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:50 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:51.830991 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f51090d6-c3a3-4d13-96bd-12c6349e8b18 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:51.832194 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f51090d6-c3a3-4d13-96bd-12c6349e8b18 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:51.840082 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f51090d6-c3a3-4d13-96bd-12c6349e8b18 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:51.840518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f51090d6-c3a3-4d13-96bd-12c6349e8b18 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:51.841272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f51090d6-c3a3-4d13-96bd-12c6349e8b18 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:51.841699 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f51090d6-c3a3-4d13-96bd-12c6349e8b18 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:52.150331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f51090d6-c3a3-4d13-96bd-12c6349e8b18 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:52.160110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f51090d6-c3a3-4d13-96bd-12c6349e8b18 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.334841 Jun 23 08:26:52.160859 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 382/758] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:51 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:53.182070 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e387e727-45a5-4b7d-a646-27921655868d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:53.183051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e387e727-45a5-4b7d-a646-27921655868d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:53.194564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e387e727-45a5-4b7d-a646-27921655868d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:53.195376 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e387e727-45a5-4b7d-a646-27921655868d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:53.196580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e387e727-45a5-4b7d-a646-27921655868d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:53.197282 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e387e727-45a5-4b7d-a646-27921655868d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:53.331748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e387e727-45a5-4b7d-a646-27921655868d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:53.340261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e387e727-45a5-4b7d-a646-27921655868d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.164671 Jun 23 08:26:53.340827 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 377/759] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:53 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:54.358277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6d175e16-cba6-4282-b80d-fcca5c21ecfe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:54.358874 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6d175e16-cba6-4282-b80d-fcca5c21ecfe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:54.365549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6d175e16-cba6-4282-b80d-fcca5c21ecfe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:54.365990 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6d175e16-cba6-4282-b80d-fcca5c21ecfe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:54.366744 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6d175e16-cba6-4282-b80d-fcca5c21ecfe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:54.367274 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6d175e16-cba6-4282-b80d-fcca5c21ecfe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:54.496837 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6d175e16-cba6-4282-b80d-fcca5c21ecfe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:54.505508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6d175e16-cba6-4282-b80d-fcca5c21ecfe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.151941 Jun 23 08:26:54.506384 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 383/760] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:54 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:54.663897 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1947089843", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-5901677", "security_groups": [{"name": "tempest-secgroup-smoke-1265977529"}], "block_device_mapping_v2": [{"uuid": "8a57eeeb-6d02-4c00-a6be-e164b7b95027", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff9e8a2b-769d-4484-bac7-f1f1f8cdf548"}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:54.788023 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] validate_networks() for [('ff9e8a2b-769d-4484-bac7-f1f1f8cdf548', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:26:55.226984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:26:55.227504 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:26:55.228174 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:26:55.228714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:26:55.229282 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:26:55.240049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:55.240482 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:55.241258 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:55.241686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:55.259914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Getting quotas for project aa6a422103704f6d982c2bc558b3387e. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:26:55.264621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Getting quotas for user 8d661ea344d74681bb7206f203033c60 and project aa6a422103704f6d982c2bc558b3387e. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:26:55.323181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:26:55.325352 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a57eeeb-6d02-4c00-a6be-e164b7b95027',volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:26:55.463559 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bf3a31ca-711e-4348-a5c3-d71558b2c060 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803797 Jun 23 08:26:55.464091 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 378/761] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:26:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:26:55.474223 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a08669a9-f2e5-44ec-96cd-2664d80d8a1a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:55.474819 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a08669a9-f2e5-44ec-96cd-2664d80d8a1a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:55.532956 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6e4e5900-1739-4ed2-a4ca-7c373524d341 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:55.533658 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6e4e5900-1739-4ed2-a4ca-7c373524d341 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:55.534283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a08669a9-f2e5-44ec-96cd-2664d80d8a1a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:55.540987 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e4e5900-1739-4ed2-a4ca-7c373524d341 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:55.541542 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e4e5900-1739-4ed2-a4ca-7c373524d341 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:55.542108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a08669a9-f2e5-44ec-96cd-2664d80d8a1a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1092 microversion: 2.1 time: 0.071681 Jun 23 08:26:55.542434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e4e5900-1739-4ed2-a4ca-7c373524d341 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:55.544447 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6e4e5900-1739-4ed2-a4ca-7c373524d341 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:55.544651 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 384/762] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:55 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1092 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:55.685337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6e4e5900-1739-4ed2-a4ca-7c373524d341 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:55.694235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6e4e5900-1739-4ed2-a4ca-7c373524d341 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.166796 Jun 23 08:26:55.694799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 379/763] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:55 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:26:56.560205 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3fa5f799-ce4b-47ee-ba38-1ab997eaa6a1 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:56.560787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3fa5f799-ce4b-47ee-ba38-1ab997eaa6a1 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:56.568713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3fa5f799-ce4b-47ee-ba38-1ab997eaa6a1 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:56.569324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3fa5f799-ce4b-47ee-ba38-1ab997eaa6a1 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:56.570115 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3fa5f799-ce4b-47ee-ba38-1ab997eaa6a1 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:56.570544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3fa5f799-ce4b-47ee-ba38-1ab997eaa6a1 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:56.635977 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3fa5f799-ce4b-47ee-ba38-1ab997eaa6a1 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:56.644351 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3fa5f799-ce4b-47ee-ba38-1ab997eaa6a1 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1190 microversion: 2.1 time: 0.087876 Jun 23 08:26:56.644816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 385/764] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:56 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:56.713339 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e45ee850-14af-4a25-b4df-29166c3154e4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:56.714087 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e45ee850-14af-4a25-b4df-29166c3154e4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:56.721496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e45ee850-14af-4a25-b4df-29166c3154e4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:56.722018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e45ee850-14af-4a25-b4df-29166c3154e4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:56.723162 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e45ee850-14af-4a25-b4df-29166c3154e4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:56.723616 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e45ee850-14af-4a25-b4df-29166c3154e4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:56.913320 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e45ee850-14af-4a25-b4df-29166c3154e4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:56.921638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e45ee850-14af-4a25-b4df-29166c3154e4 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.213125 Jun 23 08:26:56.922204 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 380/765] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:56 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:57.663835 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-53b26327-ab78-4221-9092-b0353c805613 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:57.664504 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-53b26327-ab78-4221-9092-b0353c805613 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:57.671275 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53b26327-ab78-4221-9092-b0353c805613 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:57.671724 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53b26327-ab78-4221-9092-b0353c805613 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:57.672492 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53b26327-ab78-4221-9092-b0353c805613 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:57.672918 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-53b26327-ab78-4221-9092-b0353c805613 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:57.779495 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:26:57.780103 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Thu Jun 23 08:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:26:57.808971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-53b26327-ab78-4221-9092-b0353c805613 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:57.817581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-53b26327-ab78-4221-9092-b0353c805613 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.158116 Jun 23 08:26:57.818405 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 386/766] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:57 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:57.939084 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2a5193c8-d1b5-4bec-803c-33a259932453 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:57.939730 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2a5193c8-d1b5-4bec-803c-33a259932453 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:57.947198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2a5193c8-d1b5-4bec-803c-33a259932453 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:57.947678 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2a5193c8-d1b5-4bec-803c-33a259932453 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:57.948567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2a5193c8-d1b5-4bec-803c-33a259932453 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:57.949137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2a5193c8-d1b5-4bec-803c-33a259932453 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:58.152760 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2a5193c8-d1b5-4bec-803c-33a259932453 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:58.161845 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2a5193c8-d1b5-4bec-803c-33a259932453 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.226701 Jun 23 08:26:58.162437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 381/767] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:57 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:58.268737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-b7330dec-ef62-4336-8777-322f2256a578 req-01a2e79c-a171-4068-b529-106efc4f6477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220cbacb-32cd-462b-b1a3-55330d9b7513", "tag": "c6562fa6-81c6-4f29-bc56-82db2bb52c48"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:26:58.278168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-b7330dec-ef62-4336-8777-322f2256a578 req-01a2e79c-a171-4068-b529-106efc4f6477 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:58.278874 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-b7330dec-ef62-4336-8777-322f2256a578 req-01a2e79c-a171-4068-b529-106efc4f6477 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:58.291517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-b7330dec-ef62-4336-8777-322f2256a578 req-01a2e79c-a171-4068-b529-106efc4f6477 service nova] Creating event network-changed:c6562fa6-81c6-4f29-bc56-82db2bb52c48 for instance 220cbacb-32cd-462b-b1a3-55330d9b7513 on hv-cinder-84721 Jun 23 08:26:58.297061 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-b7330dec-ef62-4336-8777-322f2256a578 req-01a2e79c-a171-4068-b529-106efc4f6477 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032329 Jun 23 08:26:58.297675 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 387/768] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:26:58.835591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-46c600fd-cd89-4e1c-9a3c-a36d8415019a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:58.836232 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-46c600fd-cd89-4e1c-9a3c-a36d8415019a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:58.843123 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-46c600fd-cd89-4e1c-9a3c-a36d8415019a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:58.843592 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-46c600fd-cd89-4e1c-9a3c-a36d8415019a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:58.844349 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-46c600fd-cd89-4e1c-9a3c-a36d8415019a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:58.844781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-46c600fd-cd89-4e1c-9a3c-a36d8415019a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:58.987917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-46c600fd-cd89-4e1c-9a3c-a36d8415019a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:58.996721 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-46c600fd-cd89-4e1c-9a3c-a36d8415019a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.165136 Jun 23 08:26:58.997260 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 382/769] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:58 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:26:59.185862 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-eb3b0cc7-937f-4396-a0ca-073adad745f5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:26:59.187072 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-eb3b0cc7-937f-4396-a0ca-073adad745f5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:26:59.198844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eb3b0cc7-937f-4396-a0ca-073adad745f5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:59.199855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eb3b0cc7-937f-4396-a0ca-073adad745f5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:59.201245 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eb3b0cc7-937f-4396-a0ca-073adad745f5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:26:59.202232 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-eb3b0cc7-937f-4396-a0ca-073adad745f5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:26:59.354554 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-eb3b0cc7-937f-4396-a0ca-073adad745f5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:26:59.364569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-eb3b0cc7-937f-4396-a0ca-073adad745f5 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.187437 Jun 23 08:26:59.365145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 388/770] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:26:59 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:00.018388 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-29a5621a-062c-4bf2-a5d3-8a0738c36e3a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:00.018992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-29a5621a-062c-4bf2-a5d3-8a0738c36e3a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:00.025683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-29a5621a-062c-4bf2-a5d3-8a0738c36e3a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:00.026129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-29a5621a-062c-4bf2-a5d3-8a0738c36e3a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:00.026886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-29a5621a-062c-4bf2-a5d3-8a0738c36e3a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:00.027339 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-29a5621a-062c-4bf2-a5d3-8a0738c36e3a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:00.240702 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-29a5621a-062c-4bf2-a5d3-8a0738c36e3a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:00.249212 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-29a5621a-062c-4bf2-a5d3-8a0738c36e3a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.234849 Jun 23 08:27:00.249845 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 383/771] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:00 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:00.382730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d12dec96-87f6-4a2b-86b7-19150969bc65 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:00.383351 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d12dec96-87f6-4a2b-86b7-19150969bc65 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:00.390144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d12dec96-87f6-4a2b-86b7-19150969bc65 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:00.390589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d12dec96-87f6-4a2b-86b7-19150969bc65 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:00.391600 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d12dec96-87f6-4a2b-86b7-19150969bc65 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:00.392062 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d12dec96-87f6-4a2b-86b7-19150969bc65 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:00.529148 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d12dec96-87f6-4a2b-86b7-19150969bc65 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:00.537565 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d12dec96-87f6-4a2b-86b7-19150969bc65 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.158745 Jun 23 08:27:00.538149 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 389/772] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:00 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:01.269772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-700d6743-6e60-4de7-b41b-2496c1adf6a0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:01.270403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-700d6743-6e60-4de7-b41b-2496c1adf6a0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:01.277511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-700d6743-6e60-4de7-b41b-2496c1adf6a0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:01.277973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-700d6743-6e60-4de7-b41b-2496c1adf6a0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:01.278745 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-700d6743-6e60-4de7-b41b-2496c1adf6a0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:01.279226 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-700d6743-6e60-4de7-b41b-2496c1adf6a0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:01.416938 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-700d6743-6e60-4de7-b41b-2496c1adf6a0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:01.424994 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-700d6743-6e60-4de7-b41b-2496c1adf6a0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.160477 Jun 23 08:27:01.425569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 384/773] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:01 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:01.559102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f63ad542-d8cb-4a3b-8a17-129de2127745 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:01.559957 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f63ad542-d8cb-4a3b-8a17-129de2127745 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:01.570782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f63ad542-d8cb-4a3b-8a17-129de2127745 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:01.571569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f63ad542-d8cb-4a3b-8a17-129de2127745 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:01.572807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f63ad542-d8cb-4a3b-8a17-129de2127745 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:01.573501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f63ad542-d8cb-4a3b-8a17-129de2127745 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:01.709280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f63ad542-d8cb-4a3b-8a17-129de2127745 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:01.721172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f63ad542-d8cb-4a3b-8a17-129de2127745 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.168859 Jun 23 08:27:01.721740 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 390/774] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:01 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:02.443700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-99ccbb20-a0ed-4a32-8f26-a7c9def52376 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:02.444306 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-99ccbb20-a0ed-4a32-8f26-a7c9def52376 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:02.451600 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-99ccbb20-a0ed-4a32-8f26-a7c9def52376 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:02.452039 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-99ccbb20-a0ed-4a32-8f26-a7c9def52376 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:02.452799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-99ccbb20-a0ed-4a32-8f26-a7c9def52376 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:02.453222 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-99ccbb20-a0ed-4a32-8f26-a7c9def52376 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:02.609350 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-99ccbb20-a0ed-4a32-8f26-a7c9def52376 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:02.617465 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-99ccbb20-a0ed-4a32-8f26-a7c9def52376 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.178192 Jun 23 08:27:02.618027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 385/775] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:02 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:02.741156 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c6610f86-5b11-45e9-a7d0-931b10072a9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:02.742503 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c6610f86-5b11-45e9-a7d0-931b10072a9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:02.750041 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c6610f86-5b11-45e9-a7d0-931b10072a9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:02.750480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c6610f86-5b11-45e9-a7d0-931b10072a9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:02.751243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c6610f86-5b11-45e9-a7d0-931b10072a9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:02.751708 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c6610f86-5b11-45e9-a7d0-931b10072a9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:02.913071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c6610f86-5b11-45e9-a7d0-931b10072a9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:02.921853 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c6610f86-5b11-45e9-a7d0-931b10072a9b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.186800 Jun 23 08:27:02.922512 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 391/776] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:02 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:03.636764 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0d3d23f1-df17-45f9-94bd-94db665158f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:03.637394 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0d3d23f1-df17-45f9-94bd-94db665158f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:03.646794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d3d23f1-df17-45f9-94bd-94db665158f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:03.647252 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d3d23f1-df17-45f9-94bd-94db665158f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:03.648060 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d3d23f1-df17-45f9-94bd-94db665158f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:03.648499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0d3d23f1-df17-45f9-94bd-94db665158f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:03.798219 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0d3d23f1-df17-45f9-94bd-94db665158f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:03.806081 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0d3d23f1-df17-45f9-94bd-94db665158f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.173267 Jun 23 08:27:03.806624 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 386/777] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:03 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:03.940682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ad55c7d9-725e-4479-8fd4-e7d7a6e4c20d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:03.941264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ad55c7d9-725e-4479-8fd4-e7d7a6e4c20d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:03.948311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad55c7d9-725e-4479-8fd4-e7d7a6e4c20d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:03.948753 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad55c7d9-725e-4479-8fd4-e7d7a6e4c20d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:03.949550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad55c7d9-725e-4479-8fd4-e7d7a6e4c20d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:03.949946 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad55c7d9-725e-4479-8fd4-e7d7a6e4c20d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:04.097260 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ad55c7d9-725e-4479-8fd4-e7d7a6e4c20d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:04.106060 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ad55c7d9-725e-4479-8fd4-e7d7a6e4c20d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.169281 Jun 23 08:27:04.106633 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 392/778] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:03 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:04.824242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-adf3ec74-24ae-4d56-8fad-ec9d4192dfe4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:04.824826 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-adf3ec74-24ae-4d56-8fad-ec9d4192dfe4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:04.831807 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-adf3ec74-24ae-4d56-8fad-ec9d4192dfe4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:04.832300 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-adf3ec74-24ae-4d56-8fad-ec9d4192dfe4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:04.833068 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-adf3ec74-24ae-4d56-8fad-ec9d4192dfe4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:04.833506 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-adf3ec74-24ae-4d56-8fad-ec9d4192dfe4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:04.982319 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-adf3ec74-24ae-4d56-8fad-ec9d4192dfe4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:04.993822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-adf3ec74-24ae-4d56-8fad-ec9d4192dfe4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.173371 Jun 23 08:27:04.994387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 387/779] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:04 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:05.127857 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5a5f0bd1-85e3-4af6-bcfd-4f22bf998885 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:05.128845 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5a5f0bd1-85e3-4af6-bcfd-4f22bf998885 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:05.140221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5a5f0bd1-85e3-4af6-bcfd-4f22bf998885 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:05.140973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5a5f0bd1-85e3-4af6-bcfd-4f22bf998885 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:05.142226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5a5f0bd1-85e3-4af6-bcfd-4f22bf998885 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:05.142935 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5a5f0bd1-85e3-4af6-bcfd-4f22bf998885 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:05.286840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5a5f0bd1-85e3-4af6-bcfd-4f22bf998885 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:05.295752 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5a5f0bd1-85e3-4af6-bcfd-4f22bf998885 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.174403 Jun 23 08:27:05.296323 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 393/780] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:05 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:06.011430 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-192bd66f-dd53-424a-9c96-585219d3901e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:06.012051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-192bd66f-dd53-424a-9c96-585219d3901e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:06.014205 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:06.014933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:06.022067 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-192bd66f-dd53-424a-9c96-585219d3901e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.022505 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-192bd66f-dd53-424a-9c96-585219d3901e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.023279 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-192bd66f-dd53-424a-9c96-585219d3901e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.023853 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-192bd66f-dd53-424a-9c96-585219d3901e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.168814 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-192bd66f-dd53-424a-9c96-585219d3901e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:06.176386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-192bd66f-dd53-424a-9c96-585219d3901e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.169271 Jun 23 08:27:06.176951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 388/781] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:06 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:06.323397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-05a61be5-d812-463c-9cde-01c22d8decbe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:06.324355 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-05a61be5-d812-463c-9cde-01c22d8decbe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:06.327473 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:06.337336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-05a61be5-d812-463c-9cde-01c22d8decbe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.337825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-05a61be5-d812-463c-9cde-01c22d8decbe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.338644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-05a61be5-d812-463c-9cde-01c22d8decbe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.339080 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-05a61be5-d812-463c-9cde-01c22d8decbe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.462733 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9f795e43-8bf7-4173-8dee-7f2c4772e8cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:06.463244 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9f795e43-8bf7-4173-8dee-7f2c4772e8cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:06.469266 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f795e43-8bf7-4173-8dee-7f2c4772e8cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.470019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f795e43-8bf7-4173-8dee-7f2c4772e8cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.470809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f795e43-8bf7-4173-8dee-7f2c4772e8cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.471277 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f795e43-8bf7-4173-8dee-7f2c4772e8cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.472318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-05a61be5-d812-463c-9cde-01c22d8decbe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:06.481013 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-05a61be5-d812-463c-9cde-01c22d8decbe tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.164196 Jun 23 08:27:06.481575 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 394/782] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:06 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:06.499478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9f795e43-8bf7-4173-8dee-7f2c4772e8cb tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9/ips" status: 200 len: 150 microversion: 2.1 time: 0.148118 Jun 23 08:27:06.500198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 389/783] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:27:06 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9/ips => generated 150 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:27:06.510983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5a99389-f8f3-4285-9543-f9ac3650ea93"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:06.512110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:06.518672 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.519172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.520095 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.520526 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.600993 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Invalid volume: volume f5a99389-f8f3-4285-9543-f9ac3650ea93 is already attached to instances: 795dfab2-6368-40d4-bf89-95f37e857ceb Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: POST /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9/os-volume_attachments HTTP/1.1 Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 74 Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:27:06.602766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {"volumeAttachment": {"volumeId": "f5a99389-f8f3-4285-9543-f9ac3650ea93"}} Jun 23 08:27:06.604356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Invalid volume: volume f5a99389-f8f3-4285-9543-f9ac3650ea93 is already attached to instances: 795dfab2-6368-40d4-bf89-95f37e857ceb Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'server_id': 'dc92fdb9-d1dd-4771-b503-766a91a813e9', 'body': {'volumeAttachment': {'volumeId': 'f5a99389-f8f3-4285-9543-f9ac3650ea93'}}} Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f5a99389-f8f3-4285-9543-f9ac3650ea93 is already attached to instances: 795dfab2-6368-40d4-bf89-95f37e857ceb Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:06.605264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f5a99389-f8f3-4285-9543-f9ac3650ea93 is already attached to instances: 795dfab2-6368-40d4-bf89-95f37e857ceb Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:06.606715 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:06.608346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:06.608346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:27:06.608346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:27:06.608346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f5a99389-f8f3-4285-9543-f9ac3650ea93 is already attached to instances: 795dfab2-6368-40d4-bf89-95f37e857ceb Jun 23 08:27:06.608346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:06.608346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 400 to user: Invalid volume: volume f5a99389-f8f3-4285-9543-f9ac3650ea93 is already attached to instances: 795dfab2-6368-40d4-bf89-95f37e857ceb {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:27:06.608346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-af27067e-72f4-4a5a-93a0-6fcf0f3bc0df tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097407 Jun 23 08:27:06.608346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 395/784] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:27:06 2022] POST /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 23 08:27:06.616283 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c60e3cb2-0baf-44d4-8e44-ca6ff668adf9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:06.617572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c60e3cb2-0baf-44d4-8e44-ca6ff668adf9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:06.623943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c60e3cb2-0baf-44d4-8e44-ca6ff668adf9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.624378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c60e3cb2-0baf-44d4-8e44-ca6ff668adf9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.625152 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c60e3cb2-0baf-44d4-8e44-ca6ff668adf9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.625569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c60e3cb2-0baf-44d4-8e44-ca6ff668adf9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.651019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c60e3cb2-0baf-44d4-8e44-ca6ff668adf9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:27:06.664837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:06.734089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c60e3cb2-0baf-44d4-8e44-ca6ff668adf9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 204 len: 0 microversion: 2.1 time: 0.123474 Jun 23 08:27:06.734742 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 390/785] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:27:06 2022] DELETE /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:27:06.745925 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-aafd35a4-0173-42bc-8acf-1d2cea1dd674 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:06.746645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-aafd35a4-0173-42bc-8acf-1d2cea1dd674 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:06.756066 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-0173-42bc-8acf-1d2cea1dd674 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.756523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-0173-42bc-8acf-1d2cea1dd674 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.757289 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-0173-42bc-8acf-1d2cea1dd674 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:06.757815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-0173-42bc-8acf-1d2cea1dd674 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:06.896296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-aafd35a4-0173-42bc-8acf-1d2cea1dd674 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:06.904450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-aafd35a4-0173-42bc-8acf-1d2cea1dd674 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1681 microversion: 2.1 time: 0.163999 Jun 23 08:27:06.904993 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 396/786] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:06 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:07.199621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b1a76c64-6d6c-4c39-9338-dce2a1904f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:07.200653 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b1a76c64-6d6c-4c39-9338-dce2a1904f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:07.211181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b1a76c64-6d6c-4c39-9338-dce2a1904f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:07.211648 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b1a76c64-6d6c-4c39-9338-dce2a1904f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:07.212402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b1a76c64-6d6c-4c39-9338-dce2a1904f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:07.212839 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b1a76c64-6d6c-4c39-9338-dce2a1904f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:07.360532 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b1a76c64-6d6c-4c39-9338-dce2a1904f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:07.368841 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b1a76c64-6d6c-4c39-9338-dce2a1904f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.177113 Jun 23 08:27:07.369428 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 391/787] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:07 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:07.503838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1a0e5fad-69c4-4b00-93cf-554b755b5545 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:07.504940 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1a0e5fad-69c4-4b00-93cf-554b755b5545 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:07.513246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a0e5fad-69c4-4b00-93cf-554b755b5545 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:07.513692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a0e5fad-69c4-4b00-93cf-554b755b5545 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:07.514487 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a0e5fad-69c4-4b00-93cf-554b755b5545 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:07.514914 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a0e5fad-69c4-4b00-93cf-554b755b5545 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:07.519329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:07.648150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1a0e5fad-69c4-4b00-93cf-554b755b5545 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:07.659308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1a0e5fad-69c4-4b00-93cf-554b755b5545 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.162385 Jun 23 08:27:07.659855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 397/788] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:07 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:07.922426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cffc3f16-073d-429b-80f1-a0a9414a574d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:07.923068 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cffc3f16-073d-429b-80f1-a0a9414a574d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:07.929607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cffc3f16-073d-429b-80f1-a0a9414a574d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:07.930142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cffc3f16-073d-429b-80f1-a0a9414a574d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:07.930903 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cffc3f16-073d-429b-80f1-a0a9414a574d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:07.931363 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cffc3f16-073d-429b-80f1-a0a9414a574d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:08.076112 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cffc3f16-073d-429b-80f1-a0a9414a574d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:08.087664 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cffc3f16-073d-429b-80f1-a0a9414a574d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1681 microversion: 2.1 time: 0.169170 Jun 23 08:27:08.088203 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 392/789] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:07 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:08.388751 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f4b00734-ba25-4610-abd3-96ca90d8b13f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:08.389353 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f4b00734-ba25-4610-abd3-96ca90d8b13f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:08.396017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4b00734-ba25-4610-abd3-96ca90d8b13f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:08.396517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4b00734-ba25-4610-abd3-96ca90d8b13f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:08.397421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4b00734-ba25-4610-abd3-96ca90d8b13f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:08.397862 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4b00734-ba25-4610-abd3-96ca90d8b13f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:08.541667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f4b00734-ba25-4610-abd3-96ca90d8b13f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:08.549663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f4b00734-ba25-4610-abd3-96ca90d8b13f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.164918 Jun 23 08:27:08.550223 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 398/790] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:08 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:08.680588 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b55b2c4f-2ae6-4471-a5b5-e24c98211518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:08.681196 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b55b2c4f-2ae6-4471-a5b5-e24c98211518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:08.688197 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b55b2c4f-2ae6-4471-a5b5-e24c98211518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:08.688635 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b55b2c4f-2ae6-4471-a5b5-e24c98211518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:08.689426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b55b2c4f-2ae6-4471-a5b5-e24c98211518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:08.689854 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b55b2c4f-2ae6-4471-a5b5-e24c98211518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:08.822781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b55b2c4f-2ae6-4471-a5b5-e24c98211518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:08.830956 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b55b2c4f-2ae6-4471-a5b5-e24c98211518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.157003 Jun 23 08:27:08.831586 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 393/791] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:08 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:09.110116 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-dd266f37-17bb-4d3f-97c5-f8134add9b18 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:09.111025 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-dd266f37-17bb-4d3f-97c5-f8134add9b18 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:09.128550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd266f37-17bb-4d3f-97c5-f8134add9b18 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:09.129425 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd266f37-17bb-4d3f-97c5-f8134add9b18 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:09.130701 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd266f37-17bb-4d3f-97c5-f8134add9b18 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:09.131474 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd266f37-17bb-4d3f-97c5-f8134add9b18 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:09.280920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dd266f37-17bb-4d3f-97c5-f8134add9b18 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:09.288581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-dd266f37-17bb-4d3f-97c5-f8134add9b18 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1681 microversion: 2.1 time: 0.185608 Jun 23 08:27:09.289146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 399/792] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:09 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:09.569929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b7cd13e7-5b1c-4cfd-a081-63bde6a64d98 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:09.570837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b7cd13e7-5b1c-4cfd-a081-63bde6a64d98 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:09.579946 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b7cd13e7-5b1c-4cfd-a081-63bde6a64d98 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:09.580572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b7cd13e7-5b1c-4cfd-a081-63bde6a64d98 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:09.581636 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b7cd13e7-5b1c-4cfd-a081-63bde6a64d98 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:09.582243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b7cd13e7-5b1c-4cfd-a081-63bde6a64d98 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:09.722902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b7cd13e7-5b1c-4cfd-a081-63bde6a64d98 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:09.730705 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b7cd13e7-5b1c-4cfd-a081-63bde6a64d98 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.166304 Jun 23 08:27:09.731269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 394/793] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:09 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:09.849559 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ecc2a134-f585-4640-80e3-8eb8acccdfc3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:09.850226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ecc2a134-f585-4640-80e3-8eb8acccdfc3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:09.857684 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ecc2a134-f585-4640-80e3-8eb8acccdfc3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:09.858134 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ecc2a134-f585-4640-80e3-8eb8acccdfc3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:09.858900 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ecc2a134-f585-4640-80e3-8eb8acccdfc3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:09.859379 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ecc2a134-f585-4640-80e3-8eb8acccdfc3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:09.990884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ecc2a134-f585-4640-80e3-8eb8acccdfc3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:10.002770 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ecc2a134-f585-4640-80e3-8eb8acccdfc3 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.157409 Jun 23 08:27:10.003594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 400/794] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:09 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:10.255297 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-faabd3c2-1e8b-4c9d-9be4-df250640e45e req-90726b3a-2afd-4141-bdfc-c5b0a8164fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220cbacb-32cd-462b-b1a3-55330d9b7513", "name": "network-vif-plugged", "status": "completed", "tag": "c6562fa6-81c6-4f29-bc56-82db2bb52c48"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:10.265355 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-faabd3c2-1e8b-4c9d-9be4-df250640e45e req-90726b3a-2afd-4141-bdfc-c5b0a8164fe0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:10.265797 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-faabd3c2-1e8b-4c9d-9be4-df250640e45e req-90726b3a-2afd-4141-bdfc-c5b0a8164fe0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:10.278797 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-faabd3c2-1e8b-4c9d-9be4-df250640e45e req-90726b3a-2afd-4141-bdfc-c5b0a8164fe0 service nova] Creating event network-vif-plugged:c6562fa6-81c6-4f29-bc56-82db2bb52c48 for instance 220cbacb-32cd-462b-b1a3-55330d9b7513 on hv-cinder-84721 Jun 23 08:27:10.284273 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-faabd3c2-1e8b-4c9d-9be4-df250640e45e req-90726b3a-2afd-4141-bdfc-c5b0a8164fe0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033539 Jun 23 08:27:10.285366 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 395/795] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:10.307013 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f0789c5c-f731-4d8d-8791-3e13f7ef1c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:10.307981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f0789c5c-f731-4d8d-8791-3e13f7ef1c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:10.315726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0789c5c-f731-4d8d-8791-3e13f7ef1c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:10.316561 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0789c5c-f731-4d8d-8791-3e13f7ef1c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:10.317327 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0789c5c-f731-4d8d-8791-3e13f7ef1c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:10.317910 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0789c5c-f731-4d8d-8791-3e13f7ef1c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:10.463637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f0789c5c-f731-4d8d-8791-3e13f7ef1c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:10.472007 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f0789c5c-f731-4d8d-8791-3e13f7ef1c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1681 microversion: 2.1 time: 0.169746 Jun 23 08:27:10.472953 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 401/796] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:10 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:10.749386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0f44bdec-54f5-484e-933b-176daf270814 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:10.749992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0f44bdec-54f5-484e-933b-176daf270814 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:10.765030 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0f44bdec-54f5-484e-933b-176daf270814 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:10.765720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0f44bdec-54f5-484e-933b-176daf270814 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:10.766568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0f44bdec-54f5-484e-933b-176daf270814 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:10.766971 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0f44bdec-54f5-484e-933b-176daf270814 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:11.022235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c31759dc-bd91-4868-8bac-cb45f1f125ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:11.022795 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c31759dc-bd91-4868-8bac-cb45f1f125ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:11.029684 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c31759dc-bd91-4868-8bac-cb45f1f125ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:11.030135 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c31759dc-bd91-4868-8bac-cb45f1f125ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:11.030925 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c31759dc-bd91-4868-8bac-cb45f1f125ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:11.031393 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c31759dc-bd91-4868-8bac-cb45f1f125ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:11.091079 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0f44bdec-54f5-484e-933b-176daf270814 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:11.099127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0f44bdec-54f5-484e-933b-176daf270814 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.354660 Jun 23 08:27:11.099957 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 396/797] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:10 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:11.173326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c31759dc-bd91-4868-8bac-cb45f1f125ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:11.181977 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c31759dc-bd91-4868-8bac-cb45f1f125ac tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1735 microversion: 2.1 time: 0.163802 Jun 23 08:27:11.182769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 402/798] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:11 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:11.490343 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b7d17a52-0034-4f85-9af1-2378908387db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:11.490939 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b7d17a52-0034-4f85-9af1-2378908387db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:11.493886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:11.501808 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b7d17a52-0034-4f85-9af1-2378908387db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:11.502496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b7d17a52-0034-4f85-9af1-2378908387db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:11.503484 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b7d17a52-0034-4f85-9af1-2378908387db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:11.504213 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b7d17a52-0034-4f85-9af1-2378908387db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:11.516909 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-c949fc38-021c-4bca-a353-c72fb3eb4019 req-d8753970-ad4e-4680-8bb2-1d7d76aa4450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc92fdb9-d1dd-4771-b503-766a91a813e9", "name": "network-vif-deleted", "tag": "8490cc9a-79c6-4e36-b7ae-2c291e958bcf"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:11.525428 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c949fc38-021c-4bca-a353-c72fb3eb4019 req-d8753970-ad4e-4680-8bb2-1d7d76aa4450 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:11.526106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c949fc38-021c-4bca-a353-c72fb3eb4019 req-d8753970-ad4e-4680-8bb2-1d7d76aa4450 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:11.538006 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-c949fc38-021c-4bca-a353-c72fb3eb4019 req-d8753970-ad4e-4680-8bb2-1d7d76aa4450 service nova] Creating event network-vif-deleted:8490cc9a-79c6-4e36-b7ae-2c291e958bcf for instance dc92fdb9-d1dd-4771-b503-766a91a813e9 on hv-cinder-84721 Jun 23 08:27:11.543401 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-c949fc38-021c-4bca-a353-c72fb3eb4019 req-d8753970-ad4e-4680-8bb2-1d7d76aa4450 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030136 Jun 23 08:27:11.544624 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 403/799] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:11.588556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b7d17a52-0034-4f85-9af1-2378908387db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:11.596305 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b7d17a52-0034-4f85-9af1-2378908387db tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1614 microversion: 2.1 time: 0.109871 Jun 23 08:27:11.596975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 397/800] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:11 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:12.117710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d0a95d57-1069-4345-a63e-1f3a3ede7c2d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:12.118755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d0a95d57-1069-4345-a63e-1f3a3ede7c2d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:12.125375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0a95d57-1069-4345-a63e-1f3a3ede7c2d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.125850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0a95d57-1069-4345-a63e-1f3a3ede7c2d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.126609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0a95d57-1069-4345-a63e-1f3a3ede7c2d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.127044 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0a95d57-1069-4345-a63e-1f3a3ede7c2d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.199497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6c4994b9-9343-43b1-99c5-612a27bf1f16 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:12.200792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6c4994b9-9343-43b1-99c5-612a27bf1f16 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:12.207535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-9343-43b1-99c5-612a27bf1f16 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.208181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-9343-43b1-99c5-612a27bf1f16 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.209167 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-9343-43b1-99c5-612a27bf1f16 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.209924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6c4994b9-9343-43b1-99c5-612a27bf1f16 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.261126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d0a95d57-1069-4345-a63e-1f3a3ede7c2d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:12.269350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d0a95d57-1069-4345-a63e-1f3a3ede7c2d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1264 microversion: 2.1 time: 0.156508 Jun 23 08:27:12.269921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 404/801] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:12 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:12.350170 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6c4994b9-9343-43b1-99c5-612a27bf1f16 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:12.358742 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6c4994b9-9343-43b1-99c5-612a27bf1f16 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1715 microversion: 2.1 time: 0.163379 Jun 23 08:27:12.359565 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 398/802] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:12 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:12.417822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:12.418382 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:12.425412 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.425843 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.426597 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.427056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.514735 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] HTTP exception thrown: Cannot 'detach_volume' instance fca4749e-9663-407f-a8fd-e58e91f7d55e while it is in vm_state rescued Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Request method failure captured: Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments/4154c349-32e7-4bab-95ba-ab900ea72c6d HTTP/1.1 Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJChJuRl63ByKI4uH1OC4o9svwQYL4HltjBZBwnz5-qllbB3CpWe6Xp9jZmIprSCRruFVHJNwKDgIPOzE2-kP1fGVUBk1FT01qYJ9qbOA4y73qaa4LRrpY7TsfrjCCFhb-Xvl4ha7hGPtLKGh6Il5Kg3gY-w4aXUS_Af-aoIHBNNTI Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:27:12.516402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d08f2f4ac6d54f7484711b28f48aeeb3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}] Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: a15a0abc2f25410b8476464d7cd32802 Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:27:12.518048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Cannot 'detach_volume' instance fca4749e-9663-407f-a8fd-e58e91f7d55e while it is in vm_state rescued Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'server_id': 'fca4749e-9663-407f-a8fd-e58e91f7d55e', 'id': '4154c349-32e7-4bab-95ba-ab900ea72c6d'} Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fca4749e-9663-407f-a8fd-e58e91f7d55e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:27:12.518922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fca4749e-9663-407f-a8fd-e58e91f7d55e while it is in vm_state rescued Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fca4749e-9663-407f-a8fd-e58e91f7d55e while it is in vm_state rescued Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:12.520584 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Returning 409 to user: Cannot 'detach_volume' instance fca4749e-9663-407f-a8fd-e58e91f7d55e while it is in vm_state rescued {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:27:12.521814 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7f2901af-1173-4339-8fb8-423b45c6ea80 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments/4154c349-32e7-4bab-95ba-ab900ea72c6d" status: 409 len: 152 microversion: 2.1 time: 0.104223 Jun 23 08:27:12.521814 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 405/803] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:27:12 2022] DELETE /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments/4154c349-32e7-4bab-95ba-ab900ea72c6d => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 23 08:27:12.526947 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-268772aa-cca8-49f9-9db6-acc93ec3297e tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:12.527504 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-268772aa-cca8-49f9-9db6-acc93ec3297e tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:12.533824 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-268772aa-cca8-49f9-9db6-acc93ec3297e tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.534288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-268772aa-cca8-49f9-9db6-acc93ec3297e tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.535020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-268772aa-cca8-49f9-9db6-acc93ec3297e tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.535482 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-268772aa-cca8-49f9-9db6-acc93ec3297e tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.614304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0b4e3887-69f3-4c83-b5e8-3ab7e68391c0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:12.614856 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0b4e3887-69f3-4c83-b5e8-3ab7e68391c0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:12.618063 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-268772aa-cca8-49f9-9db6-acc93ec3297e tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "POST /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/action" status: 202 len: 0 microversion: 2.1 time: 0.094922 Jun 23 08:27:12.620893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 399/804] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:27:12 2022] POST /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:27:12.625965 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0b4e3887-69f3-4c83-b5e8-3ab7e68391c0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.626410 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0b4e3887-69f3-4c83-b5e8-3ab7e68391c0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.627189 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0b4e3887-69f3-4c83-b5e8-3ab7e68391c0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.632929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-734bac68-3a5e-499f-822d-162611ac96ad tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:12.633948 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-734bac68-3a5e-499f-822d-162611ac96ad tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:12.638325 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0b4e3887-69f3-4c83-b5e8-3ab7e68391c0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.642254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-734bac68-3a5e-499f-822d-162611ac96ad tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.642913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-734bac68-3a5e-499f-822d-162611ac96ad tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.643890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-734bac68-3a5e-499f-822d-162611ac96ad tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:12.644521 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-734bac68-3a5e-499f-822d-162611ac96ad tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:12.717742 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0b4e3887-69f3-4c83-b5e8-3ab7e68391c0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:12.727004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0b4e3887-69f3-4c83-b5e8-3ab7e68391c0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1326 microversion: 2.1 time: 0.116243 Jun 23 08:27:12.727686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 406/805] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:12 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:12.790668 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-734bac68-3a5e-499f-822d-162611ac96ad tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:12.800109 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-734bac68-3a5e-499f-822d-162611ac96ad tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1723 microversion: 2.1 time: 0.175301 Jun 23 08:27:12.800781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 400/806] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:12 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:27:13.287144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d7f1ae47-fd17-40d5-86a5-7b754a39e978 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:13.287774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d7f1ae47-fd17-40d5-86a5-7b754a39e978 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:13.295330 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d7f1ae47-fd17-40d5-86a5-7b754a39e978 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.295802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d7f1ae47-fd17-40d5-86a5-7b754a39e978 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.296603 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d7f1ae47-fd17-40d5-86a5-7b754a39e978 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.297056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d7f1ae47-fd17-40d5-86a5-7b754a39e978 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.449150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d7f1ae47-fd17-40d5-86a5-7b754a39e978 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:13.457304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d7f1ae47-fd17-40d5-86a5-7b754a39e978 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1451 microversion: 2.1 time: 0.174636 Jun 23 08:27:13.460315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 407/807] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:13 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:13.474458 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-65286aac-cb66-4d9f-8a64-cb3effa53829 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:13.475081 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-65286aac-cb66-4d9f-8a64-cb3effa53829 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:13.482866 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65286aac-cb66-4d9f-8a64-cb3effa53829 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.483388 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65286aac-cb66-4d9f-8a64-cb3effa53829 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.484296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65286aac-cb66-4d9f-8a64-cb3effa53829 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.484784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-65286aac-cb66-4d9f-8a64-cb3effa53829 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.620027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-65286aac-cb66-4d9f-8a64-cb3effa53829 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:13.628604 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-65286aac-cb66-4d9f-8a64-cb3effa53829 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1451 microversion: 2.1 time: 0.158690 Jun 23 08:27:13.629196 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 401/808] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:13 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:13.743738 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:13.744373 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:13.750543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.750987 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.751773 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.752201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.783612 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.784239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.784721 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lazy-loading 'fault' on Instance uuid dc92fdb9-d1dd-4771-b503-766a91a813e9 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:27:13.817695 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-fa6365f8-2927-4c3f-8955-db044d85a87a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:13.818221 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-fa6365f8-2927-4c3f-8955-db044d85a87a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:13.824792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fa6365f8-2927-4c3f-8955-db044d85a87a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.825233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fa6365f8-2927-4c3f-8955-db044d85a87a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.825990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fa6365f8-2927-4c3f-8955-db044d85a87a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:13.826416 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fa6365f8-2927-4c3f-8955-db044d85a87a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:13.859641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:13.867594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f292c680-cfa9-47a0-8130-29d3a5c45fff tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 200 len: 1331 microversion: 2.1 time: 0.128159 Jun 23 08:27:13.868985 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 408/809] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:13 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:13.958147 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fa6365f8-2927-4c3f-8955-db044d85a87a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:13.970371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-fa6365f8-2927-4c3f-8955-db044d85a87a tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1723 microversion: 2.1 time: 0.156662 Jun 23 08:27:13.970952 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 402/810] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:13 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:14.886361 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:14.887132 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:14.893951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:14.894413 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:14.895419 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:14.896580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:14.911863 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 HTTP/1.1 Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:27:14.913310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:27:14.914895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'dc92fdb9-d1dd-4771-b503-766a91a813e9'} Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:27:14.915726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:27:14.916913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:14.918016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:27:14.918016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3bd500e8-9e37-484c-8ed6-751298f5ef2b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 404 len: 111 microversion: 2.1 time: 0.032810 Jun 23 08:27:14.918016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 409/811] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:14 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:27:14.923915 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4252cde0-6c6d-4702-9a1d-4ae5273946e4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '.version_select at 0x7feb6b888550>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:14.947680 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4252cde0-6c6d-4702-9a1d-4ae5273946e4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183755753" status: 202 len: 0 microversion: 2.1 time: 0.027515 Jun 23 08:27:14.948488 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 403/812] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 23 08:27:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183755753 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:27:14.988778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-298d017c-3fa7-4bf8-883c-649259099518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:14.989375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-298d017c-3fa7-4bf8-883c-649259099518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:14.996746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-298d017c-3fa7-4bf8-883c-649259099518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:14.997198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-298d017c-3fa7-4bf8-883c-649259099518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:14.997973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-298d017c-3fa7-4bf8-883c-649259099518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:14.998440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-298d017c-3fa7-4bf8-883c-649259099518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:15.237446 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-298d017c-3fa7-4bf8-883c-649259099518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:15.247833 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-298d017c-3fa7-4bf8-883c-649259099518 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1723 microversion: 2.1 time: 0.263179 Jun 23 08:27:15.248820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 410/813] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:14 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:15.488071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-9d776308-0708-4b89-b9cd-6e951ba5d484 req-464d547d-f904-4ed4-ad4a-92a01067a931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220cbacb-32cd-462b-b1a3-55330d9b7513", "tag": "c6562fa6-81c6-4f29-bc56-82db2bb52c48"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:15.499009 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-9d776308-0708-4b89-b9cd-6e951ba5d484 req-464d547d-f904-4ed4-ad4a-92a01067a931 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:15.499770 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-9d776308-0708-4b89-b9cd-6e951ba5d484 req-464d547d-f904-4ed4-ad4a-92a01067a931 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:15.521625 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-9d776308-0708-4b89-b9cd-6e951ba5d484 req-464d547d-f904-4ed4-ad4a-92a01067a931 service nova] Creating event network-changed:c6562fa6-81c6-4f29-bc56-82db2bb52c48 for instance 220cbacb-32cd-462b-b1a3-55330d9b7513 on hv-cinder-84721 Jun 23 08:27:15.527496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-9d776308-0708-4b89-b9cd-6e951ba5d484 req-464d547d-f904-4ed4-ad4a-92a01067a931 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100366 Jun 23 08:27:15.528300 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 404/814] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:15.649370 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-749097f7-772c-4351-87c5-68155f25dc37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:15.649861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-749097f7-772c-4351-87c5-68155f25dc37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:15.656210 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-749097f7-772c-4351-87c5-68155f25dc37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:15.657175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-749097f7-772c-4351-87c5-68155f25dc37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:15.658025 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-749097f7-772c-4351-87c5-68155f25dc37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:15.658457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-749097f7-772c-4351-87c5-68155f25dc37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:15.738950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-749097f7-772c-4351-87c5-68155f25dc37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lazy-loading 'services' on Instance uuid 795dfab2-6368-40d4-bf89-95f37e857ceb {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:27:15.819331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-749097f7-772c-4351-87c5-68155f25dc37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments/f5a99389-f8f3-4285-9543-f9ac3650ea93" status: 202 len: 0 microversion: 2.1 time: 0.173920 Jun 23 08:27:15.819974 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 411/815] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:27:15 2022] DELETE /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments/f5a99389-f8f3-4285-9543-f9ac3650ea93 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:27:15.829832 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c4740314-5aa3-4f1e-bfa7-a881abb60b53 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:15.830915 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c4740314-5aa3-4f1e-bfa7-a881abb60b53 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:15.837568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c4740314-5aa3-4f1e-bfa7-a881abb60b53 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:15.838098 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c4740314-5aa3-4f1e-bfa7-a881abb60b53 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:15.838848 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c4740314-5aa3-4f1e-bfa7-a881abb60b53 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:15.839288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c4740314-5aa3-4f1e-bfa7-a881abb60b53 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:15.870838 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c4740314-5aa3-4f1e-bfa7-a881abb60b53 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045865 Jun 23 08:27:15.871479 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 405/816] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:27:15 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:16.267037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-337421cc-881d-4539-98f4-0e487e1049d7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:16.268758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-337421cc-881d-4539-98f4-0e487e1049d7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:16.275984 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-337421cc-881d-4539-98f4-0e487e1049d7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:16.276785 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-337421cc-881d-4539-98f4-0e487e1049d7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:16.277777 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-337421cc-881d-4539-98f4-0e487e1049d7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:16.278463 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-337421cc-881d-4539-98f4-0e487e1049d7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:16.419971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-337421cc-881d-4539-98f4-0e487e1049d7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:16.428314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-337421cc-881d-4539-98f4-0e487e1049d7 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1723 microversion: 2.1 time: 0.166078 Jun 23 08:27:16.428883 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 412/817] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:16 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:16.886879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ccf392e8-4305-43d3-9e9c-2480e5b7bba3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:16.888382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ccf392e8-4305-43d3-9e9c-2480e5b7bba3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:16.899763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ccf392e8-4305-43d3-9e9c-2480e5b7bba3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:16.900196 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ccf392e8-4305-43d3-9e9c-2480e5b7bba3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:16.900955 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ccf392e8-4305-43d3-9e9c-2480e5b7bba3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:16.901413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ccf392e8-4305-43d3-9e9c-2480e5b7bba3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:16.932163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ccf392e8-4305-43d3-9e9c-2480e5b7bba3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052014 Jun 23 08:27:16.932704 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 406/818] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:27:16 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:17.448780 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e0c14996-b927-40ea-af4e-df29c9ccc59f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:17.449458 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e0c14996-b927-40ea-af4e-df29c9ccc59f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:17.456640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e0c14996-b927-40ea-af4e-df29c9ccc59f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:17.457113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e0c14996-b927-40ea-af4e-df29c9ccc59f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:17.457948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e0c14996-b927-40ea-af4e-df29c9ccc59f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:17.458400 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e0c14996-b927-40ea-af4e-df29c9ccc59f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:17.600206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e0c14996-b927-40ea-af4e-df29c9ccc59f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:17.608674 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e0c14996-b927-40ea-af4e-df29c9ccc59f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1723 microversion: 2.1 time: 0.165354 Jun 23 08:27:17.609246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 413/819] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:17 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:17.944052 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cc9e7181-33ce-4312-9227-874cb14ea4ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:17.945094 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cc9e7181-33ce-4312-9227-874cb14ea4ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:17.952280 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cc9e7181-33ce-4312-9227-874cb14ea4ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:17.952753 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cc9e7181-33ce-4312-9227-874cb14ea4ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:17.953542 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cc9e7181-33ce-4312-9227-874cb14ea4ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:17.953963 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cc9e7181-33ce-4312-9227-874cb14ea4ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:17.971811 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:17.986337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cc9e7181-33ce-4312-9227-874cb14ea4ab tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046303 Jun 23 08:27:17.986902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 407/820] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:27:17 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:18.626601 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bd297326-b89f-4312-ae18-e2ef87c37f05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:18.627226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bd297326-b89f-4312-ae18-e2ef87c37f05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:18.634671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd297326-b89f-4312-ae18-e2ef87c37f05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:18.635124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd297326-b89f-4312-ae18-e2ef87c37f05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:18.635929 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd297326-b89f-4312-ae18-e2ef87c37f05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:18.636373 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd297326-b89f-4312-ae18-e2ef87c37f05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:18.640662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:18.769864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bd297326-b89f-4312-ae18-e2ef87c37f05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:18.778869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bd297326-b89f-4312-ae18-e2ef87c37f05 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1729 microversion: 2.1 time: 0.156574 Jun 23 08:27:18.787896 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 414/821] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:18 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:18.796212 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bb253931-5a6a-494e-8f64-8229fb38e12b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:18.804569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bb253931-5a6a-494e-8f64-8229fb38e12b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:18.820881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb253931-5a6a-494e-8f64-8229fb38e12b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:18.822768 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb253931-5a6a-494e-8f64-8229fb38e12b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:18.824142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb253931-5a6a-494e-8f64-8229fb38e12b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:18.824840 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb253931-5a6a-494e-8f64-8229fb38e12b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:18.945421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bb253931-5a6a-494e-8f64-8229fb38e12b tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153278 Jun 23 08:27:18.946830 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 408/822] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 08:27:18 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:27:18.999199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e1daf6fc-db9a-4fe7-83a3-9e68f13e4dd5 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:19.000343 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e1daf6fc-db9a-4fe7-83a3-9e68f13e4dd5 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:19.007101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e1daf6fc-db9a-4fe7-83a3-9e68f13e4dd5 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:19.007779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e1daf6fc-db9a-4fe7-83a3-9e68f13e4dd5 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:19.008799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e1daf6fc-db9a-4fe7-83a3-9e68f13e4dd5 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:19.009223 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e1daf6fc-db9a-4fe7-83a3-9e68f13e4dd5 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:19.053572 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e1daf6fc-db9a-4fe7-83a3-9e68f13e4dd5 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058633 Jun 23 08:27:19.054456 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 415/823] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:27:18 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 08:27:19.118740 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cfabeb1f-ce0f-4ef7-8a77-0c71a527df45 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:19.119304 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cfabeb1f-ce0f-4ef7-8a77-0c71a527df45 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:19.125633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfabeb1f-ce0f-4ef7-8a77-0c71a527df45 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:19.126065 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfabeb1f-ce0f-4ef7-8a77-0c71a527df45 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:19.126817 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfabeb1f-ce0f-4ef7-8a77-0c71a527df45 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:19.127249 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfabeb1f-ce0f-4ef7-8a77-0c71a527df45 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:19.153309 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cfabeb1f-ce0f-4ef7-8a77-0c71a527df45 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:27:19.241550 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cfabeb1f-ce0f-4ef7-8a77-0c71a527df45 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 204 len: 0 microversion: 2.1 time: 0.127262 Jun 23 08:27:19.246693 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 409/824] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:27:19 2022] DELETE /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:27:19.252347 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-fa2abdd8-80f7-4e97-9acf-0a81f70ef779 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:19.252966 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-fa2abdd8-80f7-4e97-9acf-0a81f70ef779 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:19.262217 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fa2abdd8-80f7-4e97-9acf-0a81f70ef779 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:19.262667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fa2abdd8-80f7-4e97-9acf-0a81f70ef779 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:19.263482 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fa2abdd8-80f7-4e97-9acf-0a81f70ef779 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:19.263917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fa2abdd8-80f7-4e97-9acf-0a81f70ef779 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:19.506181 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-fa2abdd8-80f7-4e97-9acf-0a81f70ef779 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:19.514971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-fa2abdd8-80f7-4e97-9acf-0a81f70ef779 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1682 microversion: 2.1 time: 0.266826 Jun 23 08:27:19.515575 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 416/825] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:19 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:27:20.145905 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-da64bb16-ec61-42e8-8b05-cb5608be986c req-388817a7-39c2-4698-a497-dfcb9d68f1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca4749e-9663-407f-a8fd-e58e91f7d55e", "tag": "cd2d7e86-3a51-4611-8caf-4bdf9ed2b077"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:20.156544 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-da64bb16-ec61-42e8-8b05-cb5608be986c req-388817a7-39c2-4698-a497-dfcb9d68f1f7 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:20.156974 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-da64bb16-ec61-42e8-8b05-cb5608be986c req-388817a7-39c2-4698-a497-dfcb9d68f1f7 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:20.169890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-da64bb16-ec61-42e8-8b05-cb5608be986c req-388817a7-39c2-4698-a497-dfcb9d68f1f7 service nova] Creating event network-changed:cd2d7e86-3a51-4611-8caf-4bdf9ed2b077 for instance fca4749e-9663-407f-a8fd-e58e91f7d55e on hv-cinder-84721 Jun 23 08:27:20.185208 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-da64bb16-ec61-42e8-8b05-cb5608be986c req-388817a7-39c2-4698-a497-dfcb9d68f1f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043752 Jun 23 08:27:20.185946 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 410/826] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:20.534800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-423fefa3-99b3-4581-aa2e-6c931677f4be tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:20.536003 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-423fefa3-99b3-4581-aa2e-6c931677f4be tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:20.545951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=77 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:20.547746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-423fefa3-99b3-4581-aa2e-6c931677f4be tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:20.548199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-423fefa3-99b3-4581-aa2e-6c931677f4be tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:20.549051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-423fefa3-99b3-4581-aa2e-6c931677f4be tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:20.549485 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-423fefa3-99b3-4581-aa2e-6c931677f4be tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:20.693693 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-423fefa3-99b3-4581-aa2e-6c931677f4be tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:20.701641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-423fefa3-99b3-4581-aa2e-6c931677f4be tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1682 microversion: 2.1 time: 0.173043 Jun 23 08:27:20.702407 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 417/827] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:20 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:21.720933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f9dcc48b-a175-4694-aba6-403fcf4a4a08 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:21.721620 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f9dcc48b-a175-4694-aba6-403fcf4a4a08 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:21.728354 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9dcc48b-a175-4694-aba6-403fcf4a4a08 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:21.728792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9dcc48b-a175-4694-aba6-403fcf4a4a08 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:21.729545 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9dcc48b-a175-4694-aba6-403fcf4a4a08 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:21.729968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9dcc48b-a175-4694-aba6-403fcf4a4a08 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:21.823431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f9dcc48b-a175-4694-aba6-403fcf4a4a08 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:21.832859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f9dcc48b-a175-4694-aba6-403fcf4a4a08 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 200 len: 1614 microversion: 2.1 time: 0.116515 Jun 23 08:27:21.842506 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 411/828] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:21 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:21.887972 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-47598b05-e612-4d93-a67f-5e6e488aaae9 req-f31b37d0-965c-4c73-9459-03d16ec96ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795dfab2-6368-40d4-bf89-95f37e857ceb", "name": "network-vif-deleted", "tag": "9cdd8d49-4a4d-48e0-bf8b-c4d771ada3d9"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:21.897030 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-47598b05-e612-4d93-a67f-5e6e488aaae9 req-f31b37d0-965c-4c73-9459-03d16ec96ba7 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:21.897517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-47598b05-e612-4d93-a67f-5e6e488aaae9 req-f31b37d0-965c-4c73-9459-03d16ec96ba7 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:21.909032 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-47598b05-e612-4d93-a67f-5e6e488aaae9 req-f31b37d0-965c-4c73-9459-03d16ec96ba7 service nova] Creating event network-vif-deleted:9cdd8d49-4a4d-48e0-bf8b-c4d771ada3d9 for instance 795dfab2-6368-40d4-bf89-95f37e857ceb on hv-cinder-84721 Jun 23 08:27:21.914237 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-47598b05-e612-4d93-a67f-5e6e488aaae9 req-f31b37d0-965c-4c73-9459-03d16ec96ba7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029863 Jun 23 08:27:21.917873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 418/829] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:22.200197 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-f0dddb1d-c44f-4dc5-95d5-6151b6d42d0a req-1681e33f-01f3-4bf1-95b0-cef0bf627bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca4749e-9663-407f-a8fd-e58e91f7d55e", "tag": "cd2d7e86-3a51-4611-8caf-4bdf9ed2b077"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:22.208307 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f0dddb1d-c44f-4dc5-95d5-6151b6d42d0a req-1681e33f-01f3-4bf1-95b0-cef0bf627bd0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:22.208729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f0dddb1d-c44f-4dc5-95d5-6151b6d42d0a req-1681e33f-01f3-4bf1-95b0-cef0bf627bd0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:22.221639 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-f0dddb1d-c44f-4dc5-95d5-6151b6d42d0a req-1681e33f-01f3-4bf1-95b0-cef0bf627bd0 service nova] Creating event network-changed:cd2d7e86-3a51-4611-8caf-4bdf9ed2b077 for instance fca4749e-9663-407f-a8fd-e58e91f7d55e on hv-cinder-84721 Jun 23 08:27:22.226623 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-f0dddb1d-c44f-4dc5-95d5-6151b6d42d0a req-1681e33f-01f3-4bf1-95b0-cef0bf627bd0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030318 Jun 23 08:27:22.227408 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 412/830] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:22.850849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:22.852053 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:22.859069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:22.859556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:22.860341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:22.860752 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:22.877686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb HTTP/1.1 Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:27:22.879429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:27:22.880988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '795dfab2-6368-40d4-bf89-95f37e857ceb'} Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:27:22.881812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:27:22.883530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:22.885257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:27:22.885257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3e8bf2dd-80c9-4c94-871f-539300731bf4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 404 len: 111 microversion: 2.1 time: 0.034494 Jun 23 08:27:22.885257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 419/831] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:22 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:27:22.892536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-41426567-2b68-410e-b258-5fd4ba4bd0d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '.version_select at 0x7feb6b8379d0>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:22.913467 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-41426567-2b68-410e-b258-5fd4ba4bd0d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386311704" status: 202 len: 0 microversion: 2.1 time: 0.026927 Jun 23 08:27:22.914050 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 413/832] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 23 08:27:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386311704 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 08:27:23.587768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-49c48eb2-d588-484b-8180-dde047546e40 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: .version_select at 0x7feb6806b3a0>, body: {"keypair": {"name": "tempest-keypair-1799782136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIFiTAvnDFvV8FOyAhSSx+csKU/1tCxgLhulhY3N21lhkMJvQX1/6rnloCIQc7COUHopbo5rBxUynNYbPVRsFt+Bm8HfZJQJBfYCDRaaCJGGK5v9gioQNkLbYE2sCv2VQ=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:23.603544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-49c48eb2-d588-484b-8180-dde047546e40 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for project 4979d926d8894e3db358f16bd6bf7621. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:27:23.608064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-49c48eb2-d588-484b-8180-dde047546e40 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for user 938efacddf794fd18cd323043906b6c1 and project 4979d926d8894e3db358f16bd6bf7621. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:27:23.636651 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-49c48eb2-d588-484b-8180-dde047546e40 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053147 Jun 23 08:27:23.637275 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 420/833] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:27:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:24.906828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1836201200", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b65b84c3-0a03-45d3-ab3d-aba7b8f8cc03"}], "security_groups": [{"name": "tempest-securitygroup--1826682947"}], "key_name": "tempest-keypair-1799782136", "user_data": "}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:25.014006 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] validate_networks() for [('b65b84c3-0a03-45d3-ab3d-aba7b8f8cc03', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:27:25.397933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:27:25.398344 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:27:25.399088 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:27:25.399513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:27:25.399911 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:27:25.409677 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:25.410114 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:25.410907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:25.411359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:25.428228 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for project 4979d926d8894e3db358f16bd6bf7621. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:27:25.433554 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for user 938efacddf794fd18cd323043906b6c1 and project 4979d926d8894e3db358f16bd6bf7621. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:27:25.445992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:27:25.448429 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:27:25.508814 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a25e4b67-ccdd-48dd-8762-b7dcc30ff199 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606417 Jun 23 08:27:25.509881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 414/834] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:27:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:27:25.520546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6f36ac7a-c7af-4ced-8671-4ccf67738ae8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:25.521588 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6f36ac7a-c7af-4ced-8671-4ccf67738ae8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:25.576705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6f36ac7a-c7af-4ced-8671-4ccf67738ae8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:25.583744 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6f36ac7a-c7af-4ced-8671-4ccf67738ae8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1242 microversion: 2.1 time: 0.067540 Jun 23 08:27:25.584309 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 421/835] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:25 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:26.606968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4e3192b1-524b-4576-8221-5c313b29b990 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:26.607893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4e3192b1-524b-4576-8221-5c313b29b990 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:26.620260 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4e3192b1-524b-4576-8221-5c313b29b990 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:26.620712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4e3192b1-524b-4576-8221-5c313b29b990 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:26.621504 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4e3192b1-524b-4576-8221-5c313b29b990 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:26.621933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4e3192b1-524b-4576-8221-5c313b29b990 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:26.702695 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4e3192b1-524b-4576-8221-5c313b29b990 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:26.714393 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4e3192b1-524b-4576-8221-5c313b29b990 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1294 microversion: 2.1 time: 0.114969 Jun 23 08:27:26.714957 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 415/836] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:26 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:27.732932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9aad2cf2-fcd5-4545-aa57-cc1b95309a80 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:27.733345 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9aad2cf2-fcd5-4545-aa57-cc1b95309a80 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:27.739973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9aad2cf2-fcd5-4545-aa57-cc1b95309a80 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:27.740428 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9aad2cf2-fcd5-4545-aa57-cc1b95309a80 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:27.741191 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9aad2cf2-fcd5-4545-aa57-cc1b95309a80 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:27.741816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9aad2cf2-fcd5-4545-aa57-cc1b95309a80 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:27.897193 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9aad2cf2-fcd5-4545-aa57-cc1b95309a80 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:27.905167 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9aad2cf2-fcd5-4545-aa57-cc1b95309a80 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1368 microversion: 2.1 time: 0.176966 Jun 23 08:27:27.915293 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 422/837] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:27 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:28.465523 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-7ab87b5d-c8f3-4373-9e9d-8bb5d9ab51e0 req-3d137c66-a69a-4866-9e26-71590876f481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88daf008-0c99-48dd-8faf-598a50d7e968", "tag": "6cf6bbf6-ffa9-461c-a9d8-9e14bd2e9920"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:28.475475 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-7ab87b5d-c8f3-4373-9e9d-8bb5d9ab51e0 req-3d137c66-a69a-4866-9e26-71590876f481 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:28.476438 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-7ab87b5d-c8f3-4373-9e9d-8bb5d9ab51e0 req-3d137c66-a69a-4866-9e26-71590876f481 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:28.497776 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-7ab87b5d-c8f3-4373-9e9d-8bb5d9ab51e0 req-3d137c66-a69a-4866-9e26-71590876f481 service nova] Creating event network-changed:6cf6bbf6-ffa9-461c-a9d8-9e14bd2e9920 for instance 88daf008-0c99-48dd-8faf-598a50d7e968 on hv-cinder-84721 Jun 23 08:27:28.503431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-7ab87b5d-c8f3-4373-9e9d-8bb5d9ab51e0 req-3d137c66-a69a-4866-9e26-71590876f481 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041712 Jun 23 08:27:28.504656 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 416/838] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:28.922846 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7c696888-0050-4f16-9f79-0c81b7d0e024 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:28.923678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7c696888-0050-4f16-9f79-0c81b7d0e024 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:28.930741 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7c696888-0050-4f16-9f79-0c81b7d0e024 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:28.931177 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7c696888-0050-4f16-9f79-0c81b7d0e024 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:28.932181 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7c696888-0050-4f16-9f79-0c81b7d0e024 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:28.932606 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7c696888-0050-4f16-9f79-0c81b7d0e024 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:29.069354 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7c696888-0050-4f16-9f79-0c81b7d0e024 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:29.077736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7c696888-0050-4f16-9f79-0c81b7d0e024 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1368 microversion: 2.1 time: 0.159036 Jun 23 08:27:29.078315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 423/839] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:28 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:30.100718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-efbcdcb2-dbc8-4d68-9097-ac97ecd6e359 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:30.101883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-efbcdcb2-dbc8-4d68-9097-ac97ecd6e359 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:30.109676 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-efbcdcb2-dbc8-4d68-9097-ac97ecd6e359 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:30.110115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-efbcdcb2-dbc8-4d68-9097-ac97ecd6e359 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:30.110872 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-efbcdcb2-dbc8-4d68-9097-ac97ecd6e359 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:30.111329 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-efbcdcb2-dbc8-4d68-9097-ac97ecd6e359 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:30.252774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-efbcdcb2-dbc8-4d68-9097-ac97ecd6e359 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:30.260648 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-efbcdcb2-dbc8-4d68-9097-ac97ecd6e359 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1368 microversion: 2.1 time: 0.167827 Jun 23 08:27:30.261212 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 417/840] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:30 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:31.282222 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7cd90b23-8835-42c0-bb10-a3f0e39fbd1c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:31.283174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7cd90b23-8835-42c0-bb10-a3f0e39fbd1c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:31.298748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7cd90b23-8835-42c0-bb10-a3f0e39fbd1c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:31.299551 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7cd90b23-8835-42c0-bb10-a3f0e39fbd1c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:31.301078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7cd90b23-8835-42c0-bb10-a3f0e39fbd1c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:31.301812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7cd90b23-8835-42c0-bb10-a3f0e39fbd1c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:31.446517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7cd90b23-8835-42c0-bb10-a3f0e39fbd1c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:31.454317 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7cd90b23-8835-42c0-bb10-a3f0e39fbd1c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1368 microversion: 2.1 time: 0.178936 Jun 23 08:27:31.454881 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 424/841] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:31 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:32.472235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2f92116e-52a4-44f0-b119-0b04353b5c55 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:32.472825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2f92116e-52a4-44f0-b119-0b04353b5c55 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:32.479583 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2f92116e-52a4-44f0-b119-0b04353b5c55 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:32.480020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2f92116e-52a4-44f0-b119-0b04353b5c55 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:32.480777 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2f92116e-52a4-44f0-b119-0b04353b5c55 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:32.481829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2f92116e-52a4-44f0-b119-0b04353b5c55 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:32.676876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2f92116e-52a4-44f0-b119-0b04353b5c55 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:32.686665 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2f92116e-52a4-44f0-b119-0b04353b5c55 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1368 microversion: 2.1 time: 0.218723 Jun 23 08:27:32.687230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 418/842] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:32 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:27:33.707941 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a55a9a81-cf24-45f1-8d88-890a15d393a3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:33.708983 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a55a9a81-cf24-45f1-8d88-890a15d393a3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:33.720125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a55a9a81-cf24-45f1-8d88-890a15d393a3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:33.720856 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a55a9a81-cf24-45f1-8d88-890a15d393a3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:33.722151 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a55a9a81-cf24-45f1-8d88-890a15d393a3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:33.722869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a55a9a81-cf24-45f1-8d88-890a15d393a3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:33.871601 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a55a9a81-cf24-45f1-8d88-890a15d393a3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:33.882236 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a55a9a81-cf24-45f1-8d88-890a15d393a3 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1368 microversion: 2.1 time: 0.180497 Jun 23 08:27:33.883029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 425/843] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:33 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:34.409968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-09cc09a4-db0e-4091-a7fd-9cf46276927e req-86c86168-5dc2-4d14-bff5-4589cfe03ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88daf008-0c99-48dd-8faf-598a50d7e968", "name": "network-vif-plugged", "status": "completed", "tag": "6cf6bbf6-ffa9-461c-a9d8-9e14bd2e9920"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:34.419959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-09cc09a4-db0e-4091-a7fd-9cf46276927e req-86c86168-5dc2-4d14-bff5-4589cfe03ae7 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:34.420398 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-09cc09a4-db0e-4091-a7fd-9cf46276927e req-86c86168-5dc2-4d14-bff5-4589cfe03ae7 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:34.432053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-09cc09a4-db0e-4091-a7fd-9cf46276927e req-86c86168-5dc2-4d14-bff5-4589cfe03ae7 service nova] Creating event network-vif-plugged:6cf6bbf6-ffa9-461c-a9d8-9e14bd2e9920 for instance 88daf008-0c99-48dd-8faf-598a50d7e968 on hv-cinder-84721 Jun 23 08:27:34.437328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-09cc09a4-db0e-4091-a7fd-9cf46276927e req-86c86168-5dc2-4d14-bff5-4589cfe03ae7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031262 Jun 23 08:27:34.437911 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 419/844] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:34.902914 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1bac5e3f-25f0-4ecd-ac04-5c974aacef95 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:34.903579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1bac5e3f-25f0-4ecd-ac04-5c974aacef95 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:34.910529 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1bac5e3f-25f0-4ecd-ac04-5c974aacef95 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:34.910968 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1bac5e3f-25f0-4ecd-ac04-5c974aacef95 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:34.911767 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1bac5e3f-25f0-4ecd-ac04-5c974aacef95 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:34.912193 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1bac5e3f-25f0-4ecd-ac04-5c974aacef95 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:35.050213 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1bac5e3f-25f0-4ecd-ac04-5c974aacef95 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:35.060714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1bac5e3f-25f0-4ecd-ac04-5c974aacef95 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1368 microversion: 2.1 time: 0.162875 Jun 23 08:27:35.061309 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 426/845] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:34 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:36.080005 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e9d7954d-2127-477a-a2de-757fb855f999 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:36.080558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e9d7954d-2127-477a-a2de-757fb855f999 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:36.083026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:36.083718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:36.090675 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9d7954d-2127-477a-a2de-757fb855f999 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:36.091116 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9d7954d-2127-477a-a2de-757fb855f999 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:36.091900 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9d7954d-2127-477a-a2de-757fb855f999 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:36.092326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e9d7954d-2127-477a-a2de-757fb855f999 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:36.230638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e9d7954d-2127-477a-a2de-757fb855f999 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:36.238783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e9d7954d-2127-477a-a2de-757fb855f999 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1368 microversion: 2.1 time: 0.163093 Jun 23 08:27:36.239375 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 420/846] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:36 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:37.184291 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f4880cf0-bf5f-44bc-a6ec-59f2b1c1bdc3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:37.185516 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f4880cf0-bf5f-44bc-a6ec-59f2b1c1bdc3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:37.187815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=6 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:37.193319 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4880cf0-bf5f-44bc-a6ec-59f2b1c1bdc3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:37.193756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4880cf0-bf5f-44bc-a6ec-59f2b1c1bdc3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:37.194511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4880cf0-bf5f-44bc-a6ec-59f2b1c1bdc3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:37.194935 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4880cf0-bf5f-44bc-a6ec-59f2b1c1bdc3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:37.257405 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-67c68cfb-cfd1-49b6-8bbc-77d957e1d8d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:37.258142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-67c68cfb-cfd1-49b6-8bbc-77d957e1d8d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:37.265337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-67c68cfb-cfd1-49b6-8bbc-77d957e1d8d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:37.265812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-67c68cfb-cfd1-49b6-8bbc-77d957e1d8d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:37.266668 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-67c68cfb-cfd1-49b6-8bbc-77d957e1d8d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:37.267234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-67c68cfb-cfd1-49b6-8bbc-77d957e1d8d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:37.274054 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f4880cf0-bf5f-44bc-a6ec-59f2b1c1bdc3 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "POST /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/action" status: 202 len: 0 microversion: 2.1 time: 0.093543 Jun 23 08:27:37.274855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 427/847] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:27:37 2022] POST /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:27:37.284162 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-fb8dc994-5042-41a1-b901-76dabcd43a94 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:37.285321 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-fb8dc994-5042-41a1-b901-76dabcd43a94 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:37.291766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb8dc994-5042-41a1-b901-76dabcd43a94 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:37.292175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb8dc994-5042-41a1-b901-76dabcd43a94 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:37.292961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb8dc994-5042-41a1-b901-76dabcd43a94 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:37.293398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fb8dc994-5042-41a1-b901-76dabcd43a94 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:37.432865 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-67c68cfb-cfd1-49b6-8bbc-77d957e1d8d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:37.442215 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-67c68cfb-cfd1-49b6-8bbc-77d957e1d8d4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1558 microversion: 2.1 time: 0.189373 Jun 23 08:27:37.442766 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 421/848] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:37 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:37.446835 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-fb8dc994-5042-41a1-b901-76dabcd43a94 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:37.455680 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-fb8dc994-5042-41a1-b901-76dabcd43a94 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1748 microversion: 2.1 time: 0.175762 Jun 23 08:27:37.463267 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 428/849] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:37 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:37.463431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f47d83bd-d5b7-4277-80ea-f4491461ae5c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:37.463431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f47d83bd-d5b7-4277-80ea-f4491461ae5c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:37.466284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f47d83bd-d5b7-4277-80ea-f4491461ae5c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:37.466732 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f47d83bd-d5b7-4277-80ea-f4491461ae5c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:37.468027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f47d83bd-d5b7-4277-80ea-f4491461ae5c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:37.468490 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f47d83bd-d5b7-4277-80ea-f4491461ae5c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:37.572579 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f47d83bd-d5b7-4277-80ea-f4491461ae5c tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117497 Jun 23 08:27:37.573883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 422/850] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 08:27:37 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:27:38.474927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-382a4e63-1ad6-49f9-b81b-6c791f53cb6e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:38.475600 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-382a4e63-1ad6-49f9-b81b-6c791f53cb6e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:38.482647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-382a4e63-1ad6-49f9-b81b-6c791f53cb6e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:38.483163 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-382a4e63-1ad6-49f9-b81b-6c791f53cb6e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:38.484052 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-382a4e63-1ad6-49f9-b81b-6c791f53cb6e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:38.484460 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-382a4e63-1ad6-49f9-b81b-6c791f53cb6e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:38.632418 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-382a4e63-1ad6-49f9-b81b-6c791f53cb6e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:38.640720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-382a4e63-1ad6-49f9-b81b-6c791f53cb6e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1748 microversion: 2.1 time: 0.170497 Jun 23 08:27:38.641318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 429/851] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:38 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:39.040956 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-4733ebfd-8f84-49de-b481-5fa656b32115 req-02f2f757-9500-49ae-8c87-a1df6267a9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88daf008-0c99-48dd-8faf-598a50d7e968", "tag": "6cf6bbf6-ffa9-461c-a9d8-9e14bd2e9920"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:39.049567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-4733ebfd-8f84-49de-b481-5fa656b32115 req-02f2f757-9500-49ae-8c87-a1df6267a9a5 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:39.050269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-4733ebfd-8f84-49de-b481-5fa656b32115 req-02f2f757-9500-49ae-8c87-a1df6267a9a5 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:39.068610 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-4733ebfd-8f84-49de-b481-5fa656b32115 req-02f2f757-9500-49ae-8c87-a1df6267a9a5 service nova] Creating event network-changed:6cf6bbf6-ffa9-461c-a9d8-9e14bd2e9920 for instance 88daf008-0c99-48dd-8faf-598a50d7e968 on hv-cinder-84721 Jun 23 08:27:39.073906 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-4733ebfd-8f84-49de-b481-5fa656b32115 req-02f2f757-9500-49ae-8c87-a1df6267a9a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037234 Jun 23 08:27:39.074554 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 423/852] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:39.657829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6a97d980-6cc0-4dc7-b0bf-8d28d3b04ad5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:39.658439 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6a97d980-6cc0-4dc7-b0bf-8d28d3b04ad5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:39.666086 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6a97d980-6cc0-4dc7-b0bf-8d28d3b04ad5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:39.666573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6a97d980-6cc0-4dc7-b0bf-8d28d3b04ad5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:39.667338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6a97d980-6cc0-4dc7-b0bf-8d28d3b04ad5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:39.667776 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6a97d980-6cc0-4dc7-b0bf-8d28d3b04ad5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:39.813250 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6a97d980-6cc0-4dc7-b0bf-8d28d3b04ad5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:39.821740 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6a97d980-6cc0-4dc7-b0bf-8d28d3b04ad5 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.167715 Jun 23 08:27:39.822301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 430/853] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:39 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:40.841858 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-fd7fc9af-26f0-4134-9c31-35cb380e9d89 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:40.842570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-fd7fc9af-26f0-4134-9c31-35cb380e9d89 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:40.849551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fd7fc9af-26f0-4134-9c31-35cb380e9d89 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:40.849984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fd7fc9af-26f0-4134-9c31-35cb380e9d89 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:40.850732 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fd7fc9af-26f0-4134-9c31-35cb380e9d89 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:40.851150 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-fd7fc9af-26f0-4134-9c31-35cb380e9d89 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:41.003831 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-fd7fc9af-26f0-4134-9c31-35cb380e9d89 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:41.016282 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-fd7fc9af-26f0-4134-9c31-35cb380e9d89 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.179433 Jun 23 08:27:41.016858 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 424/854] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:40 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:42.034451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-886d8373-02b0-4fc0-b3b0-b49551115cf8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:42.035103 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-886d8373-02b0-4fc0-b3b0-b49551115cf8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:42.042320 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-886d8373-02b0-4fc0-b3b0-b49551115cf8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:42.042772 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-886d8373-02b0-4fc0-b3b0-b49551115cf8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:42.043593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-886d8373-02b0-4fc0-b3b0-b49551115cf8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:42.044028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-886d8373-02b0-4fc0-b3b0-b49551115cf8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:42.201868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-886d8373-02b0-4fc0-b3b0-b49551115cf8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:42.210884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-886d8373-02b0-4fc0-b3b0-b49551115cf8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.180972 Jun 23 08:27:42.211471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 431/855] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:42 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:43.236229 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d995c337-0d1b-4d41-9abf-36b1605f2b19 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:43.236862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d995c337-0d1b-4d41-9abf-36b1605f2b19 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:43.239644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:43.245795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d995c337-0d1b-4d41-9abf-36b1605f2b19 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:43.246284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d995c337-0d1b-4d41-9abf-36b1605f2b19 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:43.247095 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d995c337-0d1b-4d41-9abf-36b1605f2b19 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:43.247607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d995c337-0d1b-4d41-9abf-36b1605f2b19 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:43.400330 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d995c337-0d1b-4d41-9abf-36b1605f2b19 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:43.413815 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d995c337-0d1b-4d41-9abf-36b1605f2b19 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.183132 Jun 23 08:27:43.414603 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 425/856] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:43 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:44.438395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-11ac8bd6-0677-46a2-a857-d86ea7747a27 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:44.439092 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-11ac8bd6-0677-46a2-a857-d86ea7747a27 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:44.447185 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-11ac8bd6-0677-46a2-a857-d86ea7747a27 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:44.447758 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-11ac8bd6-0677-46a2-a857-d86ea7747a27 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:44.448651 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-11ac8bd6-0677-46a2-a857-d86ea7747a27 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:44.449158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-11ac8bd6-0677-46a2-a857-d86ea7747a27 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:44.606226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-11ac8bd6-0677-46a2-a857-d86ea7747a27 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:44.616027 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-11ac8bd6-0677-46a2-a857-d86ea7747a27 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.184579 Jun 23 08:27:44.616593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 432/857] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:44 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:45.418958 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e49f08ce-f6d7-4af2-a335-8cb92be0b71c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:45.419904 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e49f08ce-f6d7-4af2-a335-8cb92be0b71c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:45.428201 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e49f08ce-f6d7-4af2-a335-8cb92be0b71c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:45.428644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e49f08ce-f6d7-4af2-a335-8cb92be0b71c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:45.429391 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e49f08ce-f6d7-4af2-a335-8cb92be0b71c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:45.429815 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e49f08ce-f6d7-4af2-a335-8cb92be0b71c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:45.460793 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e49f08ce-f6d7-4af2-a335-8cb92be0b71c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments/d8194cfe-bf63-4b3f-8c75-3326a691f4f9" status: 200 len: 194 microversion: 2.20 time: 0.048582 Jun 23 08:27:45.461683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 426/858] 10.222.0.33 () {60 vars in 1453 bytes} [Thu Jun 23 08:27:45 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments/d8194cfe-bf63-4b3f-8c75-3326a691f4f9 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:27:45.529395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c8b95c00-14c3-4e61-82e5-5781a0f190c3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:45.529942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c8b95c00-14c3-4e61-82e5-5781a0f190c3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:45.537146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8b95c00-14c3-4e61-82e5-5781a0f190c3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:45.537592 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8b95c00-14c3-4e61-82e5-5781a0f190c3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:45.538352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8b95c00-14c3-4e61-82e5-5781a0f190c3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:45.538784 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8b95c00-14c3-4e61-82e5-5781a0f190c3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:45.542804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:45.621665 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-c8b95c00-14c3-4e61-82e5-5781a0f190c3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lazy-loading 'services' on Instance uuid a62a72a3-1376-4284-94a0-d57fbe81f1b9 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:27:45.633808 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-31c0c743-055c-4c75-91fc-af2c5c2212f9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:45.634407 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-31c0c743-055c-4c75-91fc-af2c5c2212f9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:45.640710 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-31c0c743-055c-4c75-91fc-af2c5c2212f9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:45.641145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-31c0c743-055c-4c75-91fc-af2c5c2212f9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:45.641973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-31c0c743-055c-4c75-91fc-af2c5c2212f9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:45.642372 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-31c0c743-055c-4c75-91fc-af2c5c2212f9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:45.697025 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c8b95c00-14c3-4e61-82e5-5781a0f190c3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments/d8194cfe-bf63-4b3f-8c75-3326a691f4f9" status: 202 len: 0 microversion: 2.20 time: 0.171441 Jun 23 08:27:45.697725 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 433/859] 10.222.0.33 () {60 vars in 1456 bytes} [Thu Jun 23 08:27:45 2022] DELETE /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments/d8194cfe-bf63-4b3f-8c75-3326a691f4f9 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:27:45.714629 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2ce7268b-3582-482f-b772-0d322e5a8341 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:45.715705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2ce7268b-3582-482f-b772-0d322e5a8341 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:45.722491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ce7268b-3582-482f-b772-0d322e5a8341 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:45.722932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ce7268b-3582-482f-b772-0d322e5a8341 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:45.723743 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ce7268b-3582-482f-b772-0d322e5a8341 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:45.724176 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ce7268b-3582-482f-b772-0d322e5a8341 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:45.755182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2ce7268b-3582-482f-b772-0d322e5a8341 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052850 Jun 23 08:27:45.756222 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 434/860] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 23 08:27:45 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:27:45.799833 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-31c0c743-055c-4c75-91fc-af2c5c2212f9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:45.808892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-31c0c743-055c-4c75-91fc-af2c5c2212f9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.178967 Jun 23 08:27:45.809453 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 427/861] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:45 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:46.767175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7b46e317-caec-4410-bbab-67c9fa6930fb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:46.768149 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7b46e317-caec-4410-bbab-67c9fa6930fb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:46.774443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7b46e317-caec-4410-bbab-67c9fa6930fb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:46.774885 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7b46e317-caec-4410-bbab-67c9fa6930fb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:46.775676 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7b46e317-caec-4410-bbab-67c9fa6930fb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:46.776108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7b46e317-caec-4410-bbab-67c9fa6930fb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:46.805914 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7b46e317-caec-4410-bbab-67c9fa6930fb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042707 Jun 23 08:27:46.806534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 435/862] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 23 08:27:46 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:27:46.826387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0a928375-1eea-4f79-aad0-f1598d8a8d68 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:46.827021 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0a928375-1eea-4f79-aad0-f1598d8a8d68 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:46.834542 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a928375-1eea-4f79-aad0-f1598d8a8d68 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:46.835156 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a928375-1eea-4f79-aad0-f1598d8a8d68 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:46.835863 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a928375-1eea-4f79-aad0-f1598d8a8d68 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:46.836290 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a928375-1eea-4f79-aad0-f1598d8a8d68 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:46.840514 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:46.985647 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0a928375-1eea-4f79-aad0-f1598d8a8d68 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:46.994837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0a928375-1eea-4f79-aad0-f1598d8a8d68 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.172449 Jun 23 08:27:46.995437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 428/863] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:46 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:47.822594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c5afd686-09d9-4a29-84c0-ebe3a58a4cab tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:47.823944 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c5afd686-09d9-4a29-84c0-ebe3a58a4cab tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:47.834264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5afd686-09d9-4a29-84c0-ebe3a58a4cab tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:47.834733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5afd686-09d9-4a29-84c0-ebe3a58a4cab tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:47.835538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5afd686-09d9-4a29-84c0-ebe3a58a4cab tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:47.835967 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c5afd686-09d9-4a29-84c0-ebe3a58a4cab tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:47.866136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c5afd686-09d9-4a29-84c0-ebe3a58a4cab tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050657 Jun 23 08:27:47.866727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 436/864] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 23 08:27:47 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:47.923641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c15103d4-bd71-4668-8a88-ac6cc288a646 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:47.924157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c15103d4-bd71-4668-8a88-ac6cc288a646 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:47.931132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c15103d4-bd71-4668-8a88-ac6cc288a646 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:47.931591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c15103d4-bd71-4668-8a88-ac6cc288a646 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:47.932380 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c15103d4-bd71-4668-8a88-ac6cc288a646 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:47.932801 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c15103d4-bd71-4668-8a88-ac6cc288a646 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:47.958844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c15103d4-bd71-4668-8a88-ac6cc288a646 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:27:48.011778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-88e21316-5467-4956-a516-ac49a880894e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:48.012373 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-88e21316-5467-4956-a516-ac49a880894e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:48.019325 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-88e21316-5467-4956-a516-ac49a880894e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:48.019787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-88e21316-5467-4956-a516-ac49a880894e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:48.020533 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-88e21316-5467-4956-a516-ac49a880894e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:48.020987 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-88e21316-5467-4956-a516-ac49a880894e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:48.043075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c15103d4-bd71-4668-8a88-ac6cc288a646 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 204 len: 0 microversion: 2.20 time: 0.122866 Jun 23 08:27:48.044154 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 429/865] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 23 08:27:47 2022] DELETE /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 08:27:48.053483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:48.054176 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:48.060655 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:48.061111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:48.061867 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:48.062298 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:48.174775 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-88e21316-5467-4956-a516-ac49a880894e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:48.183233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-88e21316-5467-4956-a516-ac49a880894e tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.175335 Jun 23 08:27:48.183812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 437/866] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:48 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:48.197269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:48.205350 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:48.206880 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:48.208460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1f48537b-50b9-40e3-8ce2-10d55c6ffc37 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.159194 Jun 23 08:27:48.209158 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 430/867] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:48 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:27:49.202139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6325ccbe-7179-42d7-8e40-fe1e571d3a4f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:49.202845 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6325ccbe-7179-42d7-8e40-fe1e571d3a4f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:49.210724 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6325ccbe-7179-42d7-8e40-fe1e571d3a4f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:49.211175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6325ccbe-7179-42d7-8e40-fe1e571d3a4f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:49.211977 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6325ccbe-7179-42d7-8e40-fe1e571d3a4f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:49.212413 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6325ccbe-7179-42d7-8e40-fe1e571d3a4f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:49.232991 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:49.233674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:49.240539 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:49.240986 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:49.241743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:49.242167 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:49.355132 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-6325ccbe-7179-42d7-8e40-fe1e571d3a4f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:49.363440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6325ccbe-7179-42d7-8e40-fe1e571d3a4f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.166032 Jun 23 08:27:49.364419 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 438/868] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:49 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:49.375856 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:49.385618 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:49.387231 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:49.388465 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7d139efb-23a5-4ee6-9f67-e924745a8d7e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.159493 Jun 23 08:27:49.389517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 431/869] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:49 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:27:50.381069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-dcdbbeb6-a45e-4f5f-931a-7f7a3a10c2cc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:50.381613 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-dcdbbeb6-a45e-4f5f-931a-7f7a3a10c2cc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:50.388671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dcdbbeb6-a45e-4f5f-931a-7f7a3a10c2cc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:50.389112 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dcdbbeb6-a45e-4f5f-931a-7f7a3a10c2cc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:50.389869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dcdbbeb6-a45e-4f5f-931a-7f7a3a10c2cc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:50.390295 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dcdbbeb6-a45e-4f5f-931a-7f7a3a10c2cc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:50.407081 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:50.407705 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:50.415293 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:50.415851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:50.416820 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:50.417256 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:50.548118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dcdbbeb6-a45e-4f5f-931a-7f7a3a10c2cc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:50.556822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-dcdbbeb6-a45e-4f5f-931a-7f7a3a10c2cc tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.179873 Jun 23 08:27:50.557398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 439/870] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:50 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:50.614951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:50.623962 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:50.625455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:50.626617 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9116cdc6-5d4a-4fc6-9aa6-3ca2e4a1e70a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1723 microversion: 2.20 time: 0.223521 Jun 23 08:27:50.627188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 432/871] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:50 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:27:51.002846 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-54b34597-d515-41a7-b24b-7f164a8a7a0c req-e62e10ab-2538-4689-80ee-cb2a0dcd9c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62a72a3-1376-4284-94a0-d57fbe81f1b9", "name": "network-vif-deleted", "tag": "95dc486f-023d-4b75-87c7-155fbce47ca4"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:51.006835 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:27:51.016337 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-54b34597-d515-41a7-b24b-7f164a8a7a0c req-e62e10ab-2538-4689-80ee-cb2a0dcd9c8c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:51.016956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-54b34597-d515-41a7-b24b-7f164a8a7a0c req-e62e10ab-2538-4689-80ee-cb2a0dcd9c8c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:51.035991 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-54b34597-d515-41a7-b24b-7f164a8a7a0c req-e62e10ab-2538-4689-80ee-cb2a0dcd9c8c service nova] Creating event network-vif-deleted:95dc486f-023d-4b75-87c7-155fbce47ca4 for instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 on hv-cinder-84721 Jun 23 08:27:51.042084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-54b34597-d515-41a7-b24b-7f164a8a7a0c req-e62e10ab-2538-4689-80ee-cb2a0dcd9c8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042869 Jun 23 08:27:51.042893 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 440/872] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:51.574375 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dc333a15-9cf4-49e9-82d2-51f606c58ef8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:51.575193 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dc333a15-9cf4-49e9-82d2-51f606c58ef8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:51.582075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc333a15-9cf4-49e9-82d2-51f606c58ef8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:51.582508 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc333a15-9cf4-49e9-82d2-51f606c58ef8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:51.583531 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc333a15-9cf4-49e9-82d2-51f606c58ef8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:51.584233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dc333a15-9cf4-49e9-82d2-51f606c58ef8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:51.646760 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:51.648397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:51.655402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:51.656815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:51.658070 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:51.658744 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:51.714876 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:51.715383 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:51.715913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lazy-loading 'fault' on Instance uuid a62a72a3-1376-4284-94a0-d57fbe81f1b9 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:27:51.755862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-dc333a15-9cf4-49e9-82d2-51f606c58ef8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:51.762487 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:51.764668 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dc333a15-9cf4-49e9-82d2-51f606c58ef8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.194371 Jun 23 08:27:51.765319 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 433/873] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:51 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:51.769817 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:51.771382 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:51.772527 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1d944566-e46c-4122-9218-f43257f30e0c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 200 len: 1371 microversion: 2.20 time: 0.130762 Jun 23 08:27:51.776699 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 441/874] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:51 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 1371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:27:52.787706 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-382651a5-5c7b-4104-926e-5edc20997f17 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:52.788831 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-382651a5-5c7b-4104-926e-5edc20997f17 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:52.791799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:52.792369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:52.795758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-382651a5-5c7b-4104-926e-5edc20997f17 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:52.796214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-382651a5-5c7b-4104-926e-5edc20997f17 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:52.796966 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-382651a5-5c7b-4104-926e-5edc20997f17 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:52.797390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-382651a5-5c7b-4104-926e-5edc20997f17 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:52.799190 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:52.799686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:52.800426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:52.800854 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:52.814814 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] HTTP exception thrown: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Request method failure captured: Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 HTTP/1.1 Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJBDlTr7vxIc_OETwId0KuxRkrIiVjVdCoYmGPbwoTtrirWnCZ_7OefeNnksF6QrMX5h6CJ2aGh0qAOX6NrBK2soHL7i8TztG-4WP8usy8DjMSIGQkblmiUIl1b2Oo7nkirvpCMJd_ZJaLsyqMogJhWwI0aJpXDzRUJxsycytxZjCw Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:27:52.816511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89774ed6e4964866bf6fd73e32dee267", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}] Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 9b178568bc5e4876bdab388ac3302f0a Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:27:52.818324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'a62a72a3-1376-4284-94a0-d57fbe81f1b9'} Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:27:52.819126 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:27:52.820468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:27:52.821609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Returning 404 to user: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:27:52.821609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cec2d551-e8f9-45b1-90ac-44b8a29b2b70 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 404 len: 111 microversion: 2.20 time: 0.030710 Jun 23 08:27:52.821609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 442/875] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:52 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:27:52.826943 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-61c28d98-c39c-4305-8e20-e8bb3902bedb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '.version_select at 0x7feb6805a700>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:52.850088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-61c28d98-c39c-4305-8e20-e8bb3902bedb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768616518" status: 204 len: 0 microversion: 2.20 time: 0.026565 Jun 23 08:27:52.852184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 443/876] 10.222.0.33 () {60 vars in 1261 bytes} [Thu Jun 23 08:27:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768616518 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 08:27:52.956195 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-382651a5-5c7b-4104-926e-5edc20997f17 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:52.966182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-382651a5-5c7b-4104-926e-5edc20997f17 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.184616 Jun 23 08:27:52.967546 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 434/877] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:52 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:53.501800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a45cfea4-18db-4324-89f9-deb9eba64559 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'create', calling method: .version_select at 0x7feb682b8dc0>, body: {"keypair": {"name": "tempest-keypair-1463437148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJP8rAHK8XEIxwAT7x6h7SFF4KOyakjJTCk3CntsZtwdeMuwyFFerZzf43S+xexjCAlgFjSaYJtruMG5rNpqWCY93aJkh0NGuu01s6+66YL2Yv/35Qpt+DC1BSjFTdajw=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:53.517573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-a45cfea4-18db-4324-89f9-deb9eba64559 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Getting quotas for project 89774ed6e4964866bf6fd73e32dee267. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:27:53.521551 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-a45cfea4-18db-4324-89f9-deb9eba64559 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Getting quotas for user 9b178568bc5e4876bdab388ac3302f0a and project 89774ed6e4964866bf6fd73e32dee267. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:27:53.547453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a45cfea4-18db-4324-89f9-deb9eba64559 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049548 Jun 23 08:27:53.548055 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 444/878] 10.222.0.33 () {62 vars in 1199 bytes} [Thu Jun 23 08:27:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 08:27:53.984282 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bb40612b-2654-42ea-9a99-86c0189f13e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:53.984887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bb40612b-2654-42ea-9a99-86c0189f13e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:53.991914 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb40612b-2654-42ea-9a99-86c0189f13e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:53.992752 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb40612b-2654-42ea-9a99-86c0189f13e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:53.993449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb40612b-2654-42ea-9a99-86c0189f13e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:53.994075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb40612b-2654-42ea-9a99-86c0189f13e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:54.250844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-bb40612b-2654-42ea-9a99-86c0189f13e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:54.260392 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bb40612b-2654-42ea-9a99-86c0189f13e9 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.279981 Jun 23 08:27:54.260990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 435/879] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:53 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:55.283303 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-49cb16e6-4d6d-4c3e-b945-d0cf693cc430 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:55.283923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-49cb16e6-4d6d-4c3e-b945-d0cf693cc430 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:55.287138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1366856573", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "831e0759-bd7c-494f-b76a-2b0a2318a2e7"}], "security_groups": [{"name": "tempest-securitygroup--641084732"}], "key_name": "tempest-keypair-1463437148", "user_data": "}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:55.290397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-49cb16e6-4d6d-4c3e-b945-d0cf693cc430 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:55.290831 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-49cb16e6-4d6d-4c3e-b945-d0cf693cc430 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:55.291622 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-49cb16e6-4d6d-4c3e-b945-d0cf693cc430 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:55.292076 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-49cb16e6-4d6d-4c3e-b945-d0cf693cc430 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:55.394795 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] validate_networks() for [('831e0759-bd7c-494f-b76a-2b0a2318a2e7', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:27:55.439046 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-49cb16e6-4d6d-4c3e-b945-d0cf693cc430 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:55.447698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-49cb16e6-4d6d-4c3e-b945-d0cf693cc430 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1753 microversion: 2.1 time: 0.168859 Jun 23 08:27:55.448250 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 445/880] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:55 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:55.766124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:27:55.766720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:27:55.767449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:27:55.767896 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:27:55.768410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:27:55.782009 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:55.782589 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:55.783880 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:55.784495 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:55.803545 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Getting quotas for project 89774ed6e4964866bf6fd73e32dee267. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:27:55.808144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Getting quotas for user 9b178568bc5e4876bdab388ac3302f0a and project 89774ed6e4964866bf6fd73e32dee267. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:27:55.820005 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:27:55.822325 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:27:55.875623 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5e9df381-2f9a-4c14-9b70-c6e9158f82e4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.593077 Jun 23 08:27:55.876275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 436/881] 10.222.0.33 () {62 vars in 1187 bytes} [Thu Jun 23 08:27:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 08:27:55.886434 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f3353fd8-7b32-4186-9b8b-b6b8ba832db2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:55.887238 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f3353fd8-7b32-4186-9b8b-b6b8ba832db2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:55.942705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f3353fd8-7b32-4186-9b8b-b6b8ba832db2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:55.950496 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f3353fd8-7b32-4186-9b8b-b6b8ba832db2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:55.952074 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f3353fd8-7b32-4186-9b8b-b6b8ba832db2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:55.953527 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f3353fd8-7b32-4186-9b8b-b6b8ba832db2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1282 microversion: 2.20 time: 0.070867 Jun 23 08:27:55.958053 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 446/882] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:55 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:27:56.464974 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-837b49f4-dd4f-4801-80de-5787b611600f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:56.465618 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-837b49f4-dd4f-4801-80de-5787b611600f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:56.472049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-837b49f4-dd4f-4801-80de-5787b611600f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:56.472482 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-837b49f4-dd4f-4801-80de-5787b611600f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:56.473233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-837b49f4-dd4f-4801-80de-5787b611600f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:56.473669 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-837b49f4-dd4f-4801-80de-5787b611600f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:56.619330 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-837b49f4-dd4f-4801-80de-5787b611600f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:56.627962 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-837b49f4-dd4f-4801-80de-5787b611600f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1756 microversion: 2.1 time: 0.167674 Jun 23 08:27:56.628534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 437/883] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:27:56 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:27:56.977960 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:56.978618 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:56.985759 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:56.986513 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:56.987303 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:56.987902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:57.052361 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:57.060943 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:57.062488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:57.063932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9131cb1f-268f-4628-b57d-c021833ef946 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1342 microversion: 2.20 time: 0.091627 Jun 23 08:27:57.067266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 447/884] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:56 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1342 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:27:58.083119 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:58.083725 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:58.091342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:58.091789 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:58.092548 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:58.092950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:58.310483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:58.318627 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:58.321135 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:58.322257 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7a9f8017-8e05-4522-ad80-4ba054db2769 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1407 microversion: 2.20 time: 0.243571 Jun 23 08:27:58.322808 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 438/885] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:58 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:27:58.607576 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-a9f83ee9-4a77-42a9-9a7a-eb5ac305f1d9 req-328245fe-def0-4645-af08-94d057ddea39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8439b3b6-aeb5-430a-8532-00ec6c81cbc5", "tag": "3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:27:58.618168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-a9f83ee9-4a77-42a9-9a7a-eb5ac305f1d9 req-328245fe-def0-4645-af08-94d057ddea39 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:58.618608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-a9f83ee9-4a77-42a9-9a7a-eb5ac305f1d9 req-328245fe-def0-4645-af08-94d057ddea39 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:58.631750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-a9f83ee9-4a77-42a9-9a7a-eb5ac305f1d9 req-328245fe-def0-4645-af08-94d057ddea39 service nova] Creating event network-changed:3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01 for instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 on hv-cinder-84721 Jun 23 08:27:58.637514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-a9f83ee9-4a77-42a9-9a7a-eb5ac305f1d9 req-328245fe-def0-4645-af08-94d057ddea39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033560 Jun 23 08:27:58.638123 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 448/886] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:27:59.341670 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:27:59.342234 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:27:59.349011 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:59.349456 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:59.350211 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:27:59.351026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:27:59.483986 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:59.496197 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:59.498670 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:27:59.500349 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-74dc2442-7bb0-44d8-8d1b-2db7d6310cef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1407 microversion: 2.20 time: 0.162608 Jun 23 08:27:59.501222 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 439/887] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:27:59 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:28:00.522727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:00.523467 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:00.530236 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:00.530675 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:00.531471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:00.531902 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:00.677442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:00.690580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:00.692898 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:00.694489 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ab8d0c30-1cf9-4c45-a42f-eb4b14400170 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1407 microversion: 2.20 time: 0.178949 Jun 23 08:28:00.695049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 449/888] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:28:00 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:28:01.717321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:01.718237 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:01.728496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:01.728937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:01.729716 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:01.730139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:01.860157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:01.868855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:01.870329 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:01.871448 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e94fa200-d90b-430f-8f2c-8570cc505b77 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1407 microversion: 2.20 time: 0.161218 Jun 23 08:28:01.872001 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 440/889] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:28:01 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:28:02.893799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:02.894860 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:02.903267 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:02.903738 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:02.904499 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:02.904923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:03.062113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:03.073663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:03.076383 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:03.078249 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-760069f4-b239-4a6c-9a3f-54d11e970285 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1407 microversion: 2.20 time: 0.191005 Jun 23 08:28:03.079181 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 450/890] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:28:02 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:28:04.098129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:04.098702 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:04.105965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:04.106432 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:04.107186 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:04.107644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:04.237027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:04.245887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:04.247413 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:04.248514 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f5ec2ab1-4a73-4149-b53f-2eb444bd4fe8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1407 microversion: 2.20 time: 0.154597 Jun 23 08:28:04.249084 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 441/891] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:28:04 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:28:04.629338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-17476d88-d171-4ee2-8664-d21ded9fb1e0 req-577f9c40-68c4-4197-a194-fdca97db386e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8439b3b6-aeb5-430a-8532-00ec6c81cbc5", "name": "network-vif-plugged", "status": "completed", "tag": "3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:28:04.638082 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-17476d88-d171-4ee2-8664-d21ded9fb1e0 req-577f9c40-68c4-4197-a194-fdca97db386e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:04.638544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-17476d88-d171-4ee2-8664-d21ded9fb1e0 req-577f9c40-68c4-4197-a194-fdca97db386e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:04.649775 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-17476d88-d171-4ee2-8664-d21ded9fb1e0 req-577f9c40-68c4-4197-a194-fdca97db386e service nova] Creating event network-vif-plugged:3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01 for instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 on hv-cinder-84721 Jun 23 08:28:04.655201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-17476d88-d171-4ee2-8664-d21ded9fb1e0 req-577f9c40-68c4-4197-a194-fdca97db386e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029576 Jun 23 08:28:04.655862 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 451/892] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:05.271004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:05.272178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:05.283426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:05.284243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:05.285474 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:05.286229 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:05.421074 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:05.434163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:05.436743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:05.438253 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-56e5cc1a-a8bd-431e-bb00-fd9dd8c7b05e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1407 microversion: 2.20 time: 0.173617 Jun 23 08:28:05.438943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 442/893] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:28:05 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:28:06.454683 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=6 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:06.458962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:06.459690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:06.466481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:06.466928 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:06.467729 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:06.468165 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:06.604020 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:06.612626 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:06.614096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:06.615197 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f53109c5-f3f3-4181-8d03-6cf3c337b77f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1407 microversion: 2.20 time: 0.162057 Jun 23 08:28:06.615779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 452/894] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:28:06 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:28:07.635561 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:07.636273 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:07.638644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:07.639477 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:07.647958 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:07.648510 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:07.649442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:07.649964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:07.789339 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:07.792763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:07.797779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:07.799244 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:07.800426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-967f7318-95a1-47d1-9754-2df6722fdfe4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1599 microversion: 2.20 time: 0.170046 Jun 23 08:28:07.800981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 443/895] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:28:07 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:28:07.820934 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8b580e49-c006-4772-882d-f8361cabb681 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:07.821536 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8b580e49-c006-4772-882d-f8361cabb681 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:07.831260 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b580e49-c006-4772-882d-f8361cabb681 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:07.831895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b580e49-c006-4772-882d-f8361cabb681 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:07.833038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b580e49-c006-4772-882d-f8361cabb681 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:07.833705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8b580e49-c006-4772-882d-f8361cabb681 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:07.914372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8b580e49-c006-4772-882d-f8361cabb681 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099149 Jun 23 08:28:07.915157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 453/896] 10.222.0.33 () {60 vars in 1315 bytes} [Thu Jun 23 08:28:07 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:28:08.875984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-4eba4757-11a4-493a-a04a-7b40079973bc req-ac5a1f0e-dcd1-4eab-a376-1d63f36f292c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8439b3b6-aeb5-430a-8532-00ec6c81cbc5", "tag": "3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:28:08.885430 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-4eba4757-11a4-493a-a04a-7b40079973bc req-ac5a1f0e-dcd1-4eab-a376-1d63f36f292c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:08.885860 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-4eba4757-11a4-493a-a04a-7b40079973bc req-ac5a1f0e-dcd1-4eab-a376-1d63f36f292c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:08.898019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-4eba4757-11a4-493a-a04a-7b40079973bc req-ac5a1f0e-dcd1-4eab-a376-1d63f36f292c service nova] Creating event network-changed:3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01 for instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 on hv-cinder-84721 Jun 23 08:28:08.903186 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-4eba4757-11a4-493a-a04a-7b40079973bc req-ac5a1f0e-dcd1-4eab-a376-1d63f36f292c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031284 Jun 23 08:28:08.903812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 444/897] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:26.749835 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:26.750684 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:26.754964 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9e9aaa4f-d95d-4b13-893c-7bbe1418a556 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:26.755525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9e9aaa4f-d95d-4b13-893c-7bbe1418a556 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:26.763781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9e9aaa4f-d95d-4b13-893c-7bbe1418a556 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:26.764163 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9e9aaa4f-d95d-4b13-893c-7bbe1418a556 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:26.764930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9e9aaa4f-d95d-4b13-893c-7bbe1418a556 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:26.765357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9e9aaa4f-d95d-4b13-893c-7bbe1418a556 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:26.854786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-9e9aaa4f-d95d-4b13-893c-7bbe1418a556 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lazy-loading 'services' on Instance uuid fca4749e-9663-407f-a8fd-e58e91f7d55e {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:28:26.935287 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9e9aaa4f-d95d-4b13-893c-7bbe1418a556 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments/4154c349-32e7-4bab-95ba-ab900ea72c6d" status: 202 len: 0 microversion: 2.1 time: 0.186469 Jun 23 08:28:26.936049 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 454/898] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:28:26 2022] DELETE /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments/4154c349-32e7-4bab-95ba-ab900ea72c6d => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:28:26.946060 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f6fda44e-e4d8-4552-ad9f-f33d2d5eb821 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:26.947259 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f6fda44e-e4d8-4552-ad9f-f33d2d5eb821 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:26.949711 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:26.956656 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f6fda44e-e4d8-4552-ad9f-f33d2d5eb821 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:26.958165 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f6fda44e-e4d8-4552-ad9f-f33d2d5eb821 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:26.959529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f6fda44e-e4d8-4552-ad9f-f33d2d5eb821 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:26.960025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f6fda44e-e4d8-4552-ad9f-f33d2d5eb821 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:26.994794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f6fda44e-e4d8-4552-ad9f-f33d2d5eb821 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053115 Jun 23 08:28:26.995493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 445/899] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:28:26 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:28.012997 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e5ab7cf3-f9a3-4374-b53e-11fd3a86fff8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:28.013986 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e5ab7cf3-f9a3-4374-b53e-11fd3a86fff8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:28.024320 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e5ab7cf3-f9a3-4374-b53e-11fd3a86fff8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:28.025215 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e5ab7cf3-f9a3-4374-b53e-11fd3a86fff8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:28.025966 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e5ab7cf3-f9a3-4374-b53e-11fd3a86fff8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:28.026416 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e5ab7cf3-f9a3-4374-b53e-11fd3a86fff8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:28.057140 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e5ab7cf3-f9a3-4374-b53e-11fd3a86fff8 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052862 Jun 23 08:28:28.057720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 455/900] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:28:28 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:29.073077 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cef9009b-4d65-4098-b6ec-251b312528b9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:29.074617 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cef9009b-4d65-4098-b6ec-251b312528b9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:29.081386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cef9009b-4d65-4098-b6ec-251b312528b9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:29.081827 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cef9009b-4d65-4098-b6ec-251b312528b9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:29.082552 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cef9009b-4d65-4098-b6ec-251b312528b9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:29.083005 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cef9009b-4d65-4098-b6ec-251b312528b9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:29.112422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cef9009b-4d65-4098-b6ec-251b312528b9 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045860 Jun 23 08:28:29.112973 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 446/901] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:28:29 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:28:29.189084 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6e20f136-c52b-45e4-9703-460be1889304 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:29.189627 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6e20f136-c52b-45e4-9703-460be1889304 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:29.196548 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6e20f136-c52b-45e4-9703-460be1889304 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:29.196992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6e20f136-c52b-45e4-9703-460be1889304 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:29.197745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6e20f136-c52b-45e4-9703-460be1889304 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:29.198167 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6e20f136-c52b-45e4-9703-460be1889304 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:29.225453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6e20f136-c52b-45e4-9703-460be1889304 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:28:29.312971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6e20f136-c52b-45e4-9703-460be1889304 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 204 len: 0 microversion: 2.1 time: 0.127354 Jun 23 08:28:29.313660 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 456/902] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:28:29 2022] DELETE /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 08:28:29.321562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3629997a-a046-4882-9a64-8b351047e3bd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:29.322156 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3629997a-a046-4882-9a64-8b351047e3bd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:29.328553 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3629997a-a046-4882-9a64-8b351047e3bd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:29.328990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3629997a-a046-4882-9a64-8b351047e3bd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:29.329729 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3629997a-a046-4882-9a64-8b351047e3bd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:29.330155 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3629997a-a046-4882-9a64-8b351047e3bd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:29.463057 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3629997a-a046-4882-9a64-8b351047e3bd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:29.470932 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3629997a-a046-4882-9a64-8b351047e3bd tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1689 microversion: 2.1 time: 0.153327 Jun 23 08:28:29.471530 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 447/903] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:29 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:30.488914 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-144384aa-e4f0-414a-ae19-f0325dbb1bb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:30.489601 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-144384aa-e4f0-414a-ae19-f0325dbb1bb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:30.496704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-144384aa-e4f0-414a-ae19-f0325dbb1bb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:30.497152 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-144384aa-e4f0-414a-ae19-f0325dbb1bb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:30.497919 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-144384aa-e4f0-414a-ae19-f0325dbb1bb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:30.498350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-144384aa-e4f0-414a-ae19-f0325dbb1bb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:30.646768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-144384aa-e4f0-414a-ae19-f0325dbb1bb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:30.659698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-144384aa-e4f0-414a-ae19-f0325dbb1bb2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1689 microversion: 2.1 time: 0.174673 Jun 23 08:28:30.660610 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 457/904] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:30 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:31.684177 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-80f5db96-d338-49c6-a092-56cba7ead00d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:31.685407 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-80f5db96-d338-49c6-a092-56cba7ead00d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:31.692726 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-80f5db96-d338-49c6-a092-56cba7ead00d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:31.693188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-80f5db96-d338-49c6-a092-56cba7ead00d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:31.693982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-80f5db96-d338-49c6-a092-56cba7ead00d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:31.694423 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-80f5db96-d338-49c6-a092-56cba7ead00d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:31.828928 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-80f5db96-d338-49c6-a092-56cba7ead00d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:31.836500 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-80f5db96-d338-49c6-a092-56cba7ead00d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1689 microversion: 2.1 time: 0.158865 Jun 23 08:28:31.837063 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 448/905] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:31 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:32.858905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-951db5cf-0daf-4ed4-b17a-9c719749de86 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:32.859555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-951db5cf-0daf-4ed4-b17a-9c719749de86 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:32.867251 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-951db5cf-0daf-4ed4-b17a-9c719749de86 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:32.867746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-951db5cf-0daf-4ed4-b17a-9c719749de86 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:32.868619 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-951db5cf-0daf-4ed4-b17a-9c719749de86 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:32.869053 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-951db5cf-0daf-4ed4-b17a-9c719749de86 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:33.014849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-951db5cf-0daf-4ed4-b17a-9c719749de86 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:33.022850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-951db5cf-0daf-4ed4-b17a-9c719749de86 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1689 microversion: 2.1 time: 0.170075 Jun 23 08:28:33.023454 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 458/906] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:32 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:34.040420 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-50f6ebe7-7d33-436a-8d20-782e7b709fcb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:34.041053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-50f6ebe7-7d33-436a-8d20-782e7b709fcb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:34.047968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50f6ebe7-7d33-436a-8d20-782e7b709fcb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:34.048415 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50f6ebe7-7d33-436a-8d20-782e7b709fcb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:34.049181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50f6ebe7-7d33-436a-8d20-782e7b709fcb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:34.049609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-50f6ebe7-7d33-436a-8d20-782e7b709fcb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:34.289226 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-50f6ebe7-7d33-436a-8d20-782e7b709fcb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:34.297475 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-50f6ebe7-7d33-436a-8d20-782e7b709fcb tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 200 len: 1689 microversion: 2.1 time: 0.260976 Jun 23 08:28:34.298067 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 449/907] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:34 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 1689 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:34.479549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-595d980b-327f-49e6-846e-8d5ba0e5bd71 req-5f7b0941-24fc-4aae-a2bc-20c550bea375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca4749e-9663-407f-a8fd-e58e91f7d55e", "name": "network-vif-deleted", "tag": "cd2d7e86-3a51-4611-8caf-4bdf9ed2b077"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:28:34.492056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-595d980b-327f-49e6-846e-8d5ba0e5bd71 req-5f7b0941-24fc-4aae-a2bc-20c550bea375 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:34.492568 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-595d980b-327f-49e6-846e-8d5ba0e5bd71 req-5f7b0941-24fc-4aae-a2bc-20c550bea375 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:34.517732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-595d980b-327f-49e6-846e-8d5ba0e5bd71 req-5f7b0941-24fc-4aae-a2bc-20c550bea375 service nova] Creating event network-vif-deleted:cd2d7e86-3a51-4611-8caf-4bdf9ed2b077 for instance fca4749e-9663-407f-a8fd-e58e91f7d55e on hv-cinder-84721 Jun 23 08:28:34.523927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-595d980b-327f-49e6-846e-8d5ba0e5bd71 req-5f7b0941-24fc-4aae-a2bc-20c550bea375 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049205 Jun 23 08:28:34.524977 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 459/908] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:35.317320 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:35.317981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: fca4749e-9663-407f-a8fd-e58e91f7d55e] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:35.326904 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:35.327449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:35.328145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:35.328580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:35.343024 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] HTTP exception thrown: Instance fca4749e-9663-407f-a8fd-e58e91f7d55e could not be found. Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Request method failure captured: Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e HTTP/1.1 Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJChJuRl63ByKI4uH1OC4o9svwQYL4HltjBZBwnz5-qllbB3CpWe6Xp9jZmIprSCRruFVHJNwKDgIPOzE2-kP1fGVUBk1FT01qYJ9qbOA4y73qaa4LRrpY7TsfrjCCFhb-Xvl4ha7hGPtLKGh6Il5Kg3gY-w4aXUS_Af-aoIHBNNTI Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:28:35.344747 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d08f2f4ac6d54f7484711b28f48aeeb3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}] Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: a15a0abc2f25410b8476464d7cd32802 Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance fca4749e-9663-407f-a8fd-e58e91f7d55e could not be found. Jun 23 08:28:35.346422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': 'fca4749e-9663-407f-a8fd-e58e91f7d55e'} Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca4749e-9663-407f-a8fd-e58e91f7d55e could not be found. Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:28:35.347412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca4749e-9663-407f-a8fd-e58e91f7d55e could not be found. Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca4749e-9663-407f-a8fd-e58e91f7d55e could not be found. Jun 23 08:28:35.348937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:35.350341 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Returning 404 to user: Instance fca4749e-9663-407f-a8fd-e58e91f7d55e could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:28:35.350341 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-43d20cfa-9e41-4638-9779-49942f596814 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e" status: 404 len: 111 microversion: 2.1 time: 0.034065 Jun 23 08:28:35.350341 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 450/909] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:35 2022] GET /compute/v2.1/servers/fca4749e-9663-407f-a8fd-e58e91f7d55e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:28:35.360190 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-db782ed5-308a-40c7-af84-2c6e68bbc49d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '.version_select at 0x7feb681375e0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:35.381228 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-db782ed5-308a-40c7-af84-2c6e68bbc49d tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-359633739" status: 202 len: 0 microversion: 2.1 time: 0.025755 Jun 23 08:28:35.381825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 460/910] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 23 08:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-359633739 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:28:38.281434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dce3dab9-64f4-495b-a504-b3bd69c15641 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:38.281950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dce3dab9-64f4-495b-a504-b3bd69c15641 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:38.288855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dce3dab9-64f4-495b-a504-b3bd69c15641 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:38.289301 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dce3dab9-64f4-495b-a504-b3bd69c15641 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:38.290044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dce3dab9-64f4-495b-a504-b3bd69c15641 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:38.290465 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dce3dab9-64f4-495b-a504-b3bd69c15641 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:38.318138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dce3dab9-64f4-495b-a504-b3bd69c15641 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:28:38.565142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dce3dab9-64f4-495b-a504-b3bd69c15641 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 204 len: 0 microversion: 2.1 time: 0.287053 Jun 23 08:28:38.568421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 451/911] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:28:38 2022] DELETE /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:28:38.574517 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-98220dc9-a85e-4896-82a0-835b9a93baf1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:38.575275 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-98220dc9-a85e-4896-82a0-835b9a93baf1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:38.582094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-98220dc9-a85e-4896-82a0-835b9a93baf1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:38.582541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-98220dc9-a85e-4896-82a0-835b9a93baf1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:38.583361 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-98220dc9-a85e-4896-82a0-835b9a93baf1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:38.583800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-98220dc9-a85e-4896-82a0-835b9a93baf1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:38.722324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-98220dc9-a85e-4896-82a0-835b9a93baf1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:38.730549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-98220dc9-a85e-4896-82a0-835b9a93baf1 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1507 microversion: 2.1 time: 0.160628 Jun 23 08:28:38.731159 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 461/912] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:38 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:28:39.749287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3b5006d1-11a4-40c0-aab3-1299c4ebdeaf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:39.750685 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3b5006d1-11a4-40c0-aab3-1299c4ebdeaf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:39.757858 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3b5006d1-11a4-40c0-aab3-1299c4ebdeaf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:39.758290 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3b5006d1-11a4-40c0-aab3-1299c4ebdeaf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:39.759118 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3b5006d1-11a4-40c0-aab3-1299c4ebdeaf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:39.759569 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3b5006d1-11a4-40c0-aab3-1299c4ebdeaf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:39.967371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3b5006d1-11a4-40c0-aab3-1299c4ebdeaf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:39.976538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3b5006d1-11a4-40c0-aab3-1299c4ebdeaf tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 200 len: 1507 microversion: 2.1 time: 0.231667 Jun 23 08:28:39.977623 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 452/913] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:39 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:40.037248 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-b60c6279-f4e7-4c66-a44e-35f920a4b85f req-fd79457a-07b1-4a07-a3bc-7eb4be33cb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba31757-3f23-4c93-8016-2448fa5510b9", "name": "network-vif-deleted", "tag": "0203a36b-327e-4646-9fe0-705599369659"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:28:40.046635 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-b60c6279-f4e7-4c66-a44e-35f920a4b85f req-fd79457a-07b1-4a07-a3bc-7eb4be33cb4e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:40.047228 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-b60c6279-f4e7-4c66-a44e-35f920a4b85f req-fd79457a-07b1-4a07-a3bc-7eb4be33cb4e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:40.060157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-b60c6279-f4e7-4c66-a44e-35f920a4b85f req-fd79457a-07b1-4a07-a3bc-7eb4be33cb4e service nova] Creating event network-vif-deleted:0203a36b-327e-4646-9fe0-705599369659 for instance 8ba31757-3f23-4c93-8016-2448fa5510b9 on hv-cinder-84721 Jun 23 08:28:40.066985 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-b60c6279-f4e7-4c66-a44e-35f920a4b85f req-fd79457a-07b1-4a07-a3bc-7eb4be33cb4e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036313 Jun 23 08:28:40.067899 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 462/914] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:40.994058 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:40.994762 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 8ba31757-3f23-4c93-8016-2448fa5510b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:41.002577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:41.003019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:41.003833 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:41.004261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:41.019174 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] HTTP exception thrown: Instance 8ba31757-3f23-4c93-8016-2448fa5510b9 could not be found. Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Request method failure captured: Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 HTTP/1.1 Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJChJuRl63ByKI4uH1OC4o9svwQYL4HltjBZBwnz5-qllbB3CpWe6Xp9jZmIprSCRruFVHJNwKDgIPOzE2-kP1fGVUBk1FT01qYJ9qbOA4y73qaa4LRrpY7TsfrjCCFhb-Xvl4ha7hGPtLKGh6Il5Kg3gY-w4aXUS_Af-aoIHBNNTI Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:28:41.020882 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d08f2f4ac6d54f7484711b28f48aeeb3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}] Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: a15a0abc2f25410b8476464d7cd32802 Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 8ba31757-3f23-4c93-8016-2448fa5510b9 could not be found. Jun 23 08:28:41.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '8ba31757-3f23-4c93-8016-2448fa5510b9'} Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba31757-3f23-4c93-8016-2448fa5510b9 could not be found. Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:28:41.023570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba31757-3f23-4c93-8016-2448fa5510b9 could not be found. Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba31757-3f23-4c93-8016-2448fa5510b9 could not be found. Jun 23 08:28:41.025104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:41.026547 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Returning 404 to user: Instance 8ba31757-3f23-4c93-8016-2448fa5510b9 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:28:41.026547 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-58e26866-8683-48c8-a608-899af584d63f tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9" status: 404 len: 111 microversion: 2.1 time: 0.032554 Jun 23 08:28:41.026547 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 453/915] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:40 2022] GET /compute/v2.1/servers/8ba31757-3f23-4c93-8016-2448fa5510b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:28:41.031860 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f995aa48-8b2b-4523-beaa-e6b36348b385 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:41.032440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f995aa48-8b2b-4523-beaa-e6b36348b385 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:41.039304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f995aa48-8b2b-4523-beaa-e6b36348b385 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:41.039937 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f995aa48-8b2b-4523-beaa-e6b36348b385 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:41.040501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f995aa48-8b2b-4523-beaa-e6b36348b385 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:41.040934 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f995aa48-8b2b-4523-beaa-e6b36348b385 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:41.067698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f995aa48-8b2b-4523-beaa-e6b36348b385 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:28:41.154833 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f995aa48-8b2b-4523-beaa-e6b36348b385 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 204 len: 0 microversion: 2.1 time: 0.127313 Jun 23 08:28:41.155724 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 463/916] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:28:41 2022] DELETE /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:28:41.164524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f9bd423d-8b3d-48f8-8c4a-59651893ad95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:41.165146 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f9bd423d-8b3d-48f8-8c4a-59651893ad95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:41.171478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9bd423d-8b3d-48f8-8c4a-59651893ad95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:41.171920 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9bd423d-8b3d-48f8-8c4a-59651893ad95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:41.172663 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9bd423d-8b3d-48f8-8c4a-59651893ad95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:41.173088 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f9bd423d-8b3d-48f8-8c4a-59651893ad95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:41.318963 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f9bd423d-8b3d-48f8-8c4a-59651893ad95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:41.331799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f9bd423d-8b3d-48f8-8c4a-59651893ad95 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.170734 Jun 23 08:28:41.332704 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 454/917] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:41 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:42.350647 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8f72a448-11fa-4010-94b0-4021928cb5e2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:42.351322 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8f72a448-11fa-4010-94b0-4021928cb5e2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:42.358375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f72a448-11fa-4010-94b0-4021928cb5e2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:42.358920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f72a448-11fa-4010-94b0-4021928cb5e2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:42.359720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f72a448-11fa-4010-94b0-4021928cb5e2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:42.360151 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f72a448-11fa-4010-94b0-4021928cb5e2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:42.494655 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8f72a448-11fa-4010-94b0-4021928cb5e2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15a0abc2f25410b8476464d7cd32802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f2f4ac6d54f7484711b28f48aeeb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:28:42.502796 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8f72a448-11fa-4010-94b0-4021928cb5e2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 200 len: 1521 microversion: 2.1 time: 0.156666 Jun 23 08:28:42.503830 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 464/918] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:42 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:42.519734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-87e801d1-0c9f-472a-ba58-0da7c1d3edeb req-d6fcf3ba-714a-4bb8-8cf8-19c3a4614f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2adbdb87-cc07-4747-9533-ed6cc8926aee", "name": "network-vif-deleted", "tag": "09f817fd-0504-4e71-9bac-fe9a86e146b7"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:28:42.529560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-87e801d1-0c9f-472a-ba58-0da7c1d3edeb req-d6fcf3ba-714a-4bb8-8cf8-19c3a4614f0c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:42.529901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-87e801d1-0c9f-472a-ba58-0da7c1d3edeb req-d6fcf3ba-714a-4bb8-8cf8-19c3a4614f0c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:42.541647 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-87e801d1-0c9f-472a-ba58-0da7c1d3edeb req-d6fcf3ba-714a-4bb8-8cf8-19c3a4614f0c service nova] Creating event network-vif-deleted:09f817fd-0504-4e71-9bac-fe9a86e146b7 for instance 2adbdb87-cc07-4747-9533-ed6cc8926aee on hv-cinder-84721 Jun 23 08:28:42.547080 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-87e801d1-0c9f-472a-ba58-0da7c1d3edeb req-d6fcf3ba-714a-4bb8-8cf8-19c3a4614f0c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030716 Jun 23 08:28:42.547977 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 455/919] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:43.525354 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:43.526114 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] [instance: 2adbdb87-cc07-4747-9533-ed6cc8926aee] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:28:43.533200 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:43.533642 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:43.534389 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:28:43.534813 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:28:43.548660 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] HTTP exception thrown: Instance 2adbdb87-cc07-4747-9533-ed6cc8926aee could not be found. Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Request method failure captured: Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee HTTP/1.1 Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJChJuRl63ByKI4uH1OC4o9svwQYL4HltjBZBwnz5-qllbB3CpWe6Xp9jZmIprSCRruFVHJNwKDgIPOzE2-kP1fGVUBk1FT01qYJ9qbOA4y73qaa4LRrpY7TsfrjCCFhb-Xvl4ha7hGPtLKGh6Il5Kg3gY-w4aXUS_Af-aoIHBNNTI Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:28:43.550281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d08f2f4ac6d54f7484711b28f48aeeb3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d08f2f4ac6d54f7484711b28f48aeeb3"}]}] Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: d08f2f4ac6d54f7484711b28f48aeeb3 Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1855832280 Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: a15a0abc2f25410b8476464d7cd32802 Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1855832280-project Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 2adbdb87-cc07-4747-9533-ed6cc8926aee could not be found. Jun 23 08:28:43.551920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '2adbdb87-cc07-4747-9533-ed6cc8926aee'} Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2adbdb87-cc07-4747-9533-ed6cc8926aee could not be found. Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:28:43.552851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2adbdb87-cc07-4747-9533-ed6cc8926aee could not be found. Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2adbdb87-cc07-4747-9533-ed6cc8926aee could not be found. Jun 23 08:28:43.554417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:28:43.555847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] Returning 404 to user: Instance 2adbdb87-cc07-4747-9533-ed6cc8926aee could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:28:43.555847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1821869f-954d-4cf9-9fac-517e322d55a2 tempest-ServerRescueNegativeTestJSON-1855832280 tempest-ServerRescueNegativeTestJSON-1855832280-project] 10.222.0.33 "GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee" status: 404 len: 111 microversion: 2.1 time: 0.030282 Jun 23 08:28:43.555847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 465/920] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:28:43 2022] GET /compute/v2.1/servers/2adbdb87-cc07-4747-9533-ed6cc8926aee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:28:48.102148 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:28:48.102798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Thu Jun 23 08:28:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:28:48.303226 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-567806ea-1bf4-4db6-b87e-dcff0c6a9ed0 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Action: 'create', calling method: .version_select at 0x7feb6b837430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1119703240", "metadata": {"Type": "work"}}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:28:48.600655 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-567806ea-1bf4-4db6-b87e-dcff0c6a9ed0 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.418501 Jun 23 08:28:48.601986 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 456/921] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 23 08:28:48 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 08:28:48.614458 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d60b747c-b2e6-40d4-9adf-e8a7319ff364 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Calling method '.version_select at 0x7feb682b84c0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:48.663440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d60b747c-b2e6-40d4-9adf-e8a7319ff364 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e" status: 200 len: 353 microversion: 2.1 time: 0.052939 Jun 23 08:28:48.664016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 466/922] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:28:48 2022] GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:49.681954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f13155f1-1e4e-4e38-957b-e40bb7e4ed39 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Calling method '.version_select at 0x7feb6b8aca60>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:49.733538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f13155f1-1e4e-4e38-957b-e40bb7e4ed39 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e" status: 200 len: 354 microversion: 2.1 time: 0.059113 Jun 23 08:28:49.734172 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 457/923] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:28:49 2022] GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:49.747422 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c2fa4c00-48c3-4a02-8010-1027b478a09b tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Calling method '.version_select at 0x7feb682b85e0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:49.795546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c2fa4c00-48c3-4a02-8010-1027b478a09b tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e" status: 200 len: 354 microversion: 2.1 time: 0.053311 Jun 23 08:28:49.796111 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 467/924] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:28:49 2022] GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:49.807874 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ee1aa188-588b-45f4-9786-7885e5909f58 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Calling method '.version_select at 0x7feb6b8ac0d0>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:49.877008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ee1aa188-588b-45f4-9786-7885e5909f58 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e" status: 202 len: 0 microversion: 2.1 time: 0.073072 Jun 23 08:28:49.877581 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 458/925] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:28:49 2022] DELETE /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:28:49.885821 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-99611773-59c5-4f06-a4f6-11d9f81f7fa1 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Calling method '.version_select at 0x7feb6856d0d0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:49.932750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-99611773-59c5-4f06-a4f6-11d9f81f7fa1 tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e" status: 200 len: 353 microversion: 2.1 time: 0.050853 Jun 23 08:28:49.933278 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 468/926] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:28:49 2022] GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:50.950885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d90011ad-0ae7-4967-a60f-331af5ef2bab tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Calling method '.version_select at 0x7feb6b837c10>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:50.984673 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-d90011ad-0ae7-4967-a60f-331af5ef2bab tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] HTTP exception thrown: Volume 39843a14-af4b-4b00-b17c-793d9b69549e could not be found. Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d90011ad-0ae7-4967-a60f-331af5ef2bab tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Request method failure captured: Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e HTTP/1.1 Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCRAZi1bQRA5JiBJurepKObzsTt52t4QD0AYiV5sgik_HBrXR8BwiQ2SD0XeQblFt-Nag5-wl9wgQU0v_NEYe_yHp747GPgTV9eGk5WSwadjBlKR8VN0BYSMmO6eDsRjITl_vkZICdDSybENRzJP4gMOooRtIObQLMqhwWymmZbbKCw Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 6aacebee42d84c2993866b60944cdf89 Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-VolumesGetTestJSON-1474609144 Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:28:50.987086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6aacebee42d84c2993866b60944cdf89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6aacebee42d84c2993866b60944cdf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6aacebee42d84c2993866b60944cdf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6aacebee42d84c2993866b60944cdf89"}]}] Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-VolumesGetTestJSON-1474609144 Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 6aacebee42d84c2993866b60944cdf89 Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-VolumesGetTestJSON-1474609144 Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-VolumesGetTestJSON-1474609144-project Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 405f144a98c64c4cb0661c6ff3db9918 Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-VolumesGetTestJSON-1474609144-project Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Volume 39843a14-af4b-4b00-b17c-793d9b69549e could not be found. Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '39843a14-af4b-4b00-b17c-793d9b69549e'} Jun 23 08:28:50.988607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39843a14-af4b-4b00-b17c-793d9b69549e could not be found. (HTTP 404) (Request-ID: req-78ffdfad-6c1a-4b2e-b2f0-48bf2c55678e) Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:50.989502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:28:50.990750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39843a14-af4b-4b00-b17c-793d9b69549e could not be found. Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 08:28:50.992292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39843a14-af4b-4b00-b17c-793d9b69549e could not be found. Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39843a14-af4b-4b00-b17c-793d9b69549e could not be found. Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d90011ad-0ae7-4967-a60f-331af5ef2bab tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] Returning 404 to user: Volume 39843a14-af4b-4b00-b17c-793d9b69549e could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d90011ad-0ae7-4967-a60f-331af5ef2bab tempest-VolumesGetTestJSON-1474609144 tempest-VolumesGetTestJSON-1474609144-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e" status: 404 len: 109 microversion: 2.1 time: 0.044962 Jun 23 08:28:50.993551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 459/927] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:28:50 2022] GET /compute/v2.1/os-volumes/39843a14-af4b-4b00-b17c-793d9b69549e => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:28:54.818034 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:54.818798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:54.822586 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-eb39a524-d73d-416e-a1c8-c1fd1cbd3664 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb6812d670>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:54.879082 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-eb39a524-d73d-416e-a1c8-c1fd1cbd3664 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f15fc931-7e0c-41a5-9d45-e0ba178f36cf" status: 200 len: 350 microversion: 2.1 time: 0.062201 Jun 23 08:28:54.879661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 469/928] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:28:54 2022] GET /compute/v2.1/os-volumes/f15fc931-7e0c-41a5-9d45-e0ba178f36cf => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:56.224096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:56.224874 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:28:56.229345 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-309dc62b-f510-4e6d-96eb-b9747439b4f1 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb6b837820>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:56.276521 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-309dc62b-f510-4e6d-96eb-b9747439b4f1 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1cbddf1b-60b0-4118-9a38-7badbb5fc1bf" status: 200 len: 350 microversion: 2.1 time: 0.053787 Jun 23 08:28:56.277074 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 460/929] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:28:56 2022] GET /compute/v2.1/os-volumes/1cbddf1b-60b0-4118-9a38-7badbb5fc1bf => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:57.607617 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1424817a-4c3c-4a92-94e4-a1b592c521e5 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb681999d0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:57.659449 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1424817a-4c3c-4a92-94e4-a1b592c521e5 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/95c38c77-970f-47ba-afc8-be599934af07" status: 200 len: 350 microversion: 2.1 time: 0.056104 Jun 23 08:28:57.660211 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 470/930] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:28:57 2022] GET /compute/v2.1/os-volumes/95c38c77-970f-47ba-afc8-be599934af07 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:57.675823 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ef3a91a8-6793-409a-8bf6-a68dd4ca1a88 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb6b8acb80>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:57.767850 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ef3a91a8-6793-409a-8bf6-a68dd4ca1a88 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.097488 Jun 23 08:28:57.768788 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 461/931] 10.222.0.33 () {58 vars in 1133 bytes} [Thu Jun 23 08:28:57 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:57.786739 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-12cd7d26-7072-4672-b663-c85ac94540a3 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb6807e1f0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:57.867443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-12cd7d26-7072-4672-b663-c85ac94540a3 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085859 Jun 23 08:28:57.868028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 471/932] 10.222.0.33 () {58 vars in 1148 bytes} [Thu Jun 23 08:28:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:57.883357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bed55db4-4331-4053-a334-fe606a7ccf3e tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb6b8f13a0>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:57.966465 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bed55db4-4331-4053-a334-fe606a7ccf3e tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086973 Jun 23 08:28:57.967038 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 462/933] 10.222.0.33 () {58 vars in 1133 bytes} [Thu Jun 23 08:28:57 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:57.978348 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9ee4669f-d1fa-4c5d-8a00-1b1a45345315 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb6856d0d0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:58.062986 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9ee4669f-d1fa-4c5d-8a00-1b1a45345315 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088239 Jun 23 08:28:58.063823 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 472/934] 10.222.0.33 () {58 vars in 1166 bytes} [Thu Jun 23 08:28:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:58.075816 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8aa8b477-9377-4c25-b4bc-ce979c0a4612 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb6b888f70>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:58.167316 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8aa8b477-9377-4c25-b4bc-ce979c0a4612 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095275 Jun 23 08:28:58.167913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 463/935] 10.222.0.33 () {58 vars in 1169 bytes} [Thu Jun 23 08:28:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:58.180422 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-14b30c53-bc1d-4215-a57c-7c9bf45182e1 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb682b8280>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:58.265036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-14b30c53-bc1d-4215-a57c-7c9bf45182e1 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088438 Jun 23 08:28:58.265608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 473/936] 10.222.0.33 () {58 vars in 1154 bytes} [Thu Jun 23 08:28:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:28:58.277343 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-efce582d-86e5-4ad7-924e-54d048c448f7 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb6b7e0e50>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:58.367339 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-efce582d-86e5-4ad7-924e-54d048c448f7 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093725 Jun 23 08:28:58.367923 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 464/937] 10.222.0.33 () {58 vars in 1187 bytes} [Thu Jun 23 08:28:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:28:58.380337 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4dde064c-3848-458e-abdc-7321c4e48054 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] Calling method '.version_select at 0x7feb68199ee0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:28:58.463380 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4dde064c-3848-458e-abdc-7321c4e48054 tempest-VolumesTestJSON-814274576 tempest-VolumesTestJSON-814274576-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087287 Jun 23 08:28:58.463959 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 474/938] 10.222.0.33 () {58 vars in 1154 bytes} [Thu Jun 23 08:28:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:08.725593 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-36f59704-dc30-4360-9337-8add3e454b0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:08.726198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-36f59704-dc30-4360-9337-8add3e454b0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:08.734026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36f59704-dc30-4360-9337-8add3e454b0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:08.734026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36f59704-dc30-4360-9337-8add3e454b0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:08.734774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36f59704-dc30-4360-9337-8add3e454b0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:08.735198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-36f59704-dc30-4360-9337-8add3e454b0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:08.760860 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-36f59704-dc30-4360-9337-8add3e454b0f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/ips" status: 200 len: 150 microversion: 2.1 time: 0.039801 Jun 23 08:29:08.761415 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 465/939] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:29:08 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:09.480653 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-767e5fe2-f96d-4f52-bc4f-4d5776606133 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-815976990"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:09.481525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-767e5fe2-f96d-4f52-bc4f-4d5776606133 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:09.490555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-767e5fe2-f96d-4f52-bc4f-4d5776606133 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:09.491349 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-767e5fe2-f96d-4f52-bc4f-4d5776606133 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:09.492117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-767e5fe2-f96d-4f52-bc4f-4d5776606133 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:09.492545 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-767e5fe2-f96d-4f52-bc4f-4d5776606133 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:09.635473 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.network.security_group_api [None req-767e5fe2-f96d-4f52-bc4f-4d5776606133 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Removing security group 0c560df2-acca-41e2-9d59-d7fe16f7c713 from port 45988a1f-4c36-4aab-9724-eb0b20919aef Jun 23 08:29:10.021666 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-767e5fe2-f96d-4f52-bc4f-4d5776606133 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "POST /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/action" status: 202 len: 0 microversion: 2.1 time: 0.548990 Jun 23 08:29:10.026061 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 475/940] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:29:09 2022] POST /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:29:10.054541 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-7df545f2-877b-41fd-830d-239ab65cc608 req-1b884a65-1329-40e9-bec0-67f965974c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3ae113-1126-44da-8b3a-42e7f777a8c7", "tag": "45988a1f-4c36-4aab-9724-eb0b20919aef"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:10.067894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-7df545f2-877b-41fd-830d-239ab65cc608 req-1b884a65-1329-40e9-bec0-67f965974c75 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:10.074103 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-7df545f2-877b-41fd-830d-239ab65cc608 req-1b884a65-1329-40e9-bec0-67f965974c75 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:10.106483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-7df545f2-877b-41fd-830d-239ab65cc608 req-1b884a65-1329-40e9-bec0-67f965974c75 service nova] Creating event network-changed:45988a1f-4c36-4aab-9724-eb0b20919aef for instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 on hv-cinder-84721 Jun 23 08:29:10.108975 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4e752770-1fa8-4859-a1cd-5e3dcb963e30 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "470d2353-ea84-43d0-9bec-e9c746986174"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:10.110149 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4e752770-1fa8-4859-a1cd-5e3dcb963e30 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:10.121960 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4e752770-1fa8-4859-a1cd-5e3dcb963e30 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:10.122325 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-7df545f2-877b-41fd-830d-239ab65cc608 req-1b884a65-1329-40e9-bec0-67f965974c75 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070333 Jun 23 08:29:10.123539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4e752770-1fa8-4859-a1cd-5e3dcb963e30 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:10.124339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4e752770-1fa8-4859-a1cd-5e3dcb963e30 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:10.124774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4e752770-1fa8-4859-a1cd-5e3dcb963e30 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:10.129188 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 466/941] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:10.564369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4e752770-1fa8-4859-a1cd-5e3dcb963e30 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459016 Jun 23 08:29:10.564992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 476/942] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:29:10 2022] POST /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:11.287693 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b0664b4a-035d-4eb9-86c3-e4b045c707c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:11.288855 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b0664b4a-035d-4eb9-86c3-e4b045c707c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:11.304388 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b0664b4a-035d-4eb9-86c3-e4b045c707c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:11.304964 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b0664b4a-035d-4eb9-86c3-e4b045c707c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:11.306612 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b0664b4a-035d-4eb9-86c3-e4b045c707c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:11.307056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b0664b4a-035d-4eb9-86c3-e4b045c707c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:11.397659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-b0664b4a-035d-4eb9-86c3-e4b045c707c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lazy-loading 'services' on Instance uuid ec3ae113-1126-44da-8b3a-42e7f777a8c7 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:29:11.479024 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b0664b4a-035d-4eb9-86c3-e4b045c707c4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments/a7171da4-4237-447f-ba6b-2b082906e3d4" status: 202 len: 0 microversion: 2.1 time: 0.196091 Jun 23 08:29:11.479713 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 467/943] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:29:11 2022] DELETE /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments/a7171da4-4237-447f-ba6b-2b082906e3d4 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:29:11.496061 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-13c3b01f-7798-4073-a0de-04f7ccb5d124 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:11.497196 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-13c3b01f-7798-4073-a0de-04f7ccb5d124 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:11.507159 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13c3b01f-7798-4073-a0de-04f7ccb5d124 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:11.507930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13c3b01f-7798-4073-a0de-04f7ccb5d124 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:11.509256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13c3b01f-7798-4073-a0de-04f7ccb5d124 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:11.510034 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13c3b01f-7798-4073-a0de-04f7ccb5d124 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:11.551503 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-13c3b01f-7798-4073-a0de-04f7ccb5d124 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066272 Jun 23 08:29:11.552085 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 477/944] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:11 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:12.138667 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-5d2183fd-b388-4fca-8490-84dd4769f00a req-68079b17-fbba-46a8-a2a5-40fa13f146d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3ae113-1126-44da-8b3a-42e7f777a8c7", "tag": "45988a1f-4c36-4aab-9724-eb0b20919aef"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:12.147191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-5d2183fd-b388-4fca-8490-84dd4769f00a req-68079b17-fbba-46a8-a2a5-40fa13f146d6 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:12.147664 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-5d2183fd-b388-4fca-8490-84dd4769f00a req-68079b17-fbba-46a8-a2a5-40fa13f146d6 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:12.159883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-5d2183fd-b388-4fca-8490-84dd4769f00a req-68079b17-fbba-46a8-a2a5-40fa13f146d6 service nova] Creating event network-changed:45988a1f-4c36-4aab-9724-eb0b20919aef for instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 on hv-cinder-84721 Jun 23 08:29:12.165038 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-5d2183fd-b388-4fca-8490-84dd4769f00a req-68079b17-fbba-46a8-a2a5-40fa13f146d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030624 Jun 23 08:29:12.165818 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 468/945] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:12.563716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ff14964d-ce12-4a0f-9210-d0d742f3a709 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:12.564725 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ff14964d-ce12-4a0f-9210-d0d742f3a709 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:12.571972 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff14964d-ce12-4a0f-9210-d0d742f3a709 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:12.572421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff14964d-ce12-4a0f-9210-d0d742f3a709 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:12.573283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff14964d-ce12-4a0f-9210-d0d742f3a709 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:12.573736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ff14964d-ce12-4a0f-9210-d0d742f3a709 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:12.607518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ff14964d-ce12-4a0f-9210-d0d742f3a709 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047779 Jun 23 08:29:12.608321 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 478/946] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:12 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:13.620357 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-501f9a42-2fd5-4ceb-bfa3-fa08a802659f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:13.621380 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-501f9a42-2fd5-4ceb-bfa3-fa08a802659f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:13.628160 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-501f9a42-2fd5-4ceb-bfa3-fa08a802659f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:13.628594 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-501f9a42-2fd5-4ceb-bfa3-fa08a802659f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:13.629526 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-501f9a42-2fd5-4ceb-bfa3-fa08a802659f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:13.629953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-501f9a42-2fd5-4ceb-bfa3-fa08a802659f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:13.658923 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-501f9a42-2fd5-4ceb-bfa3-fa08a802659f tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043363 Jun 23 08:29:13.659505 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 469/947] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:13 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:14.671371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1eac2a89-de1a-4f8f-85fc-9ea5024512e4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:14.672419 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1eac2a89-de1a-4f8f-85fc-9ea5024512e4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:14.679344 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1eac2a89-de1a-4f8f-85fc-9ea5024512e4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:14.679816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1eac2a89-de1a-4f8f-85fc-9ea5024512e4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:14.680574 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1eac2a89-de1a-4f8f-85fc-9ea5024512e4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:14.681001 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1eac2a89-de1a-4f8f-85fc-9ea5024512e4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:14.713593 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1eac2a89-de1a-4f8f-85fc-9ea5024512e4 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Jun 23 08:29:14.714196 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 479/948] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:14 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:15.725445 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-26d17c5c-3a31-42c4-89b1-d7523ffc3ebb tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:15.726465 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-26d17c5c-3a31-42c4-89b1-d7523ffc3ebb tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:15.733141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26d17c5c-3a31-42c4-89b1-d7523ffc3ebb tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:15.733586 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26d17c5c-3a31-42c4-89b1-d7523ffc3ebb tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:15.734324 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26d17c5c-3a31-42c4-89b1-d7523ffc3ebb tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:15.734746 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26d17c5c-3a31-42c4-89b1-d7523ffc3ebb tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:15.765379 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-26d17c5c-3a31-42c4-89b1-d7523ffc3ebb tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Jun 23 08:29:15.766077 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 470/949] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:15 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:16.777190 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cdbdcb18-c395-4ec0-9e2d-dc3695899587 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:16.778117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cdbdcb18-c395-4ec0-9e2d-dc3695899587 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:16.784965 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cdbdcb18-c395-4ec0-9e2d-dc3695899587 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:16.785409 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cdbdcb18-c395-4ec0-9e2d-dc3695899587 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:16.786182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cdbdcb18-c395-4ec0-9e2d-dc3695899587 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:16.786824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cdbdcb18-c395-4ec0-9e2d-dc3695899587 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:16.816030 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cdbdcb18-c395-4ec0-9e2d-dc3695899587 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042843 Jun 23 08:29:16.816580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 480/950] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:16 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:17.828683 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-02f897ff-a62b-4bba-8b78-498a4f0f1200 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:17.829831 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-02f897ff-a62b-4bba-8b78-498a4f0f1200 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:17.839643 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02f897ff-a62b-4bba-8b78-498a4f0f1200 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:17.840149 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02f897ff-a62b-4bba-8b78-498a4f0f1200 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:17.841019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02f897ff-a62b-4bba-8b78-498a4f0f1200 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:17.841507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-02f897ff-a62b-4bba-8b78-498a4f0f1200 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:17.880001 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-02f897ff-a62b-4bba-8b78-498a4f0f1200 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056322 Jun 23 08:29:17.880597 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 471/951] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:17 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:18.093199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "470d2353-ea84-43d0-9bec-e9c746986174"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:18.094277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:18.101328 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.101788 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.102559 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.102988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.182308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Invalid volume: volume 470d2353-ea84-43d0-9bec-e9c746986174 is already attached to instances: 88daf008-0c99-48dd-8faf-598a50d7e968 Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: POST /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments HTTP/1.1 Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 74 Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:29:18.184064 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {"volumeAttachment": {"volumeId": "470d2353-ea84-43d0-9bec-e9c746986174"}} Jun 23 08:29:18.185662 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Invalid volume: volume 470d2353-ea84-43d0-9bec-e9c746986174 is already attached to instances: 88daf008-0c99-48dd-8faf-598a50d7e968 Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'server_id': '88daf008-0c99-48dd-8faf-598a50d7e968', 'body': {'volumeAttachment': {'volumeId': '470d2353-ea84-43d0-9bec-e9c746986174'}}} Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 470d2353-ea84-43d0-9bec-e9c746986174 is already attached to instances: 88daf008-0c99-48dd-8faf-598a50d7e968 Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:18.186542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 470d2353-ea84-43d0-9bec-e9c746986174 is already attached to instances: 88daf008-0c99-48dd-8faf-598a50d7e968 Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:18.187973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:18.189468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:18.189468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:29:18.189468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:29:18.189468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 470d2353-ea84-43d0-9bec-e9c746986174 is already attached to instances: 88daf008-0c99-48dd-8faf-598a50d7e968 Jun 23 08:29:18.189468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:18.189468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 400 to user: Invalid volume: volume 470d2353-ea84-43d0-9bec-e9c746986174 is already attached to instances: 88daf008-0c99-48dd-8faf-598a50d7e968 {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:29:18.189468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f5d27467-7af1-44e3-9646-1a8099e5143f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096334 Jun 23 08:29:18.189468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 481/952] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:29:18 2022] POST /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:29:18.249757 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6d72204b-eb4c-4aa1-b288-b6400c01e57a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:18.250241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6d72204b-eb4c-4aa1-b288-b6400c01e57a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:18.256776 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6d72204b-eb4c-4aa1-b288-b6400c01e57a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.257215 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6d72204b-eb4c-4aa1-b288-b6400c01e57a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.257970 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6d72204b-eb4c-4aa1-b288-b6400c01e57a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.258392 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6d72204b-eb4c-4aa1-b288-b6400c01e57a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.344179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-6d72204b-eb4c-4aa1-b288-b6400c01e57a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lazy-loading 'services' on Instance uuid 88daf008-0c99-48dd-8faf-598a50d7e968 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:29:18.425588 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6d72204b-eb4c-4aa1-b288-b6400c01e57a tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments/470d2353-ea84-43d0-9bec-e9c746986174" status: 202 len: 0 microversion: 2.1 time: 0.179581 Jun 23 08:29:18.426222 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 472/953] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:29:18 2022] DELETE /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments/470d2353-ea84-43d0-9bec-e9c746986174 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:29:18.436632 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6f5d44f0-05b9-4c8e-b8e1-e3285562bee6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:18.437597 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6f5d44f0-05b9-4c8e-b8e1-e3285562bee6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:18.444013 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f5d44f0-05b9-4c8e-b8e1-e3285562bee6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.444446 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f5d44f0-05b9-4c8e-b8e1-e3285562bee6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.445202 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f5d44f0-05b9-4c8e-b8e1-e3285562bee6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.445616 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6f5d44f0-05b9-4c8e-b8e1-e3285562bee6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.476623 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6f5d44f0-05b9-4c8e-b8e1-e3285562bee6 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Jun 23 08:29:18.477176 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 482/954] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:18 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:18.896786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b18a562d-61b1-433f-a78f-a33bd445bdca tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:18.896786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b18a562d-61b1-433f-a78f-a33bd445bdca tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:18.901265 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b18a562d-61b1-433f-a78f-a33bd445bdca tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.901712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b18a562d-61b1-433f-a78f-a33bd445bdca tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.902473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b18a562d-61b1-433f-a78f-a33bd445bdca tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.903034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b18a562d-61b1-433f-a78f-a33bd445bdca tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.932338 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b18a562d-61b1-433f-a78f-a33bd445bdca tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043873 Jun 23 08:29:18.933198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 473/955] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:18 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:29:18.943385 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:18.944108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:18.952525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.952974 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:18.954091 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:18.954984 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:19.034017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] HTTP exception thrown: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 is not attached to volume a7171da4-4237-447f-ba6b-2b082906e3d4 Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Request method failure captured: Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments/a7171da4-4237-447f-ba6b-2b082906e3d4 HTTP/1.1 Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCNSa83HetMToBqKpLED_z6lMgWpAxfcyGDMtyTAyeQnUEo1yzIzuWPCwd7pzM-XUsuS0-nVD6JyO-XRnXLebbRSTLVbIfRw_6Yb5FSS-KD2db1C1LoHDgelAUib2zCKlKFjr0e2Xatkk2rNKufbhp1locv7IqCAuUagdKiDBqp_Zac Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 796208f488e742d1beaef6d02f0232e6 Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-TestMinimumBasicScenario-1748177594 Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:29:19.036333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_796208f488e742d1beaef6d02f0232e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/796208f488e742d1beaef6d02f0232e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/796208f488e742d1beaef6d02f0232e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/796208f488e742d1beaef6d02f0232e6"}]}] Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-TestMinimumBasicScenario-1748177594 Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 796208f488e742d1beaef6d02f0232e6 Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1748177594 Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-TestMinimumBasicScenario-1748177594-project Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: c685a84382ec4f4fbd3be4378ba14ca9 Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-TestMinimumBasicScenario-1748177594-project Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:29:19.037829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 is not attached to volume a7171da4-4237-447f-ba6b-2b082906e3d4 Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'server_id': 'ec3ae113-1126-44da-8b3a-42e7f777a8c7', 'id': 'a7171da4-4237-447f-ba6b-2b082906e3d4'} Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a7171da4-4237-447f-ba6b-2b082906e3d4. Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:29:19.038585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 is not attached to volume a7171da4-4237-447f-ba6b-2b082906e3d4 Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 is not attached to volume a7171da4-4237-447f-ba6b-2b082906e3d4 Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:19.039825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Returning 404 to user: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 is not attached to volume a7171da4-4237-447f-ba6b-2b082906e3d4 {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:29:19.040756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e140141c-807e-43d1-83a9-9f9cd1477b92 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments/a7171da4-4237-447f-ba6b-2b082906e3d4" status: 404 len: 154 microversion: 2.1 time: 0.099261 Jun 23 08:29:19.040756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 483/956] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:29:18 2022] DELETE /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7/os-volume_attachments/a7171da4-4237-447f-ba6b-2b082906e3d4 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:29:19.489386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-789906a7-4053-4e61-8074-ae3360e93d62 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:19.491469 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-789906a7-4053-4e61-8074-ae3360e93d62 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:19.498436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-789906a7-4053-4e61-8074-ae3360e93d62 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:19.498890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-789906a7-4053-4e61-8074-ae3360e93d62 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:19.499775 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-789906a7-4053-4e61-8074-ae3360e93d62 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:19.500208 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-789906a7-4053-4e61-8074-ae3360e93d62 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:19.535753 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-789906a7-4053-4e61-8074-ae3360e93d62 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050412 Jun 23 08:29:19.536349 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 474/957] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:29:19 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:29:19.597952 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2aa3bd33-9095-4435-9c44-e420dfa0d131 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:19.598525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2aa3bd33-9095-4435-9c44-e420dfa0d131 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:19.605292 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2aa3bd33-9095-4435-9c44-e420dfa0d131 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:19.605729 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2aa3bd33-9095-4435-9c44-e420dfa0d131 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:19.606486 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2aa3bd33-9095-4435-9c44-e420dfa0d131 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:19.606925 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2aa3bd33-9095-4435-9c44-e420dfa0d131 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:19.636884 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2aa3bd33-9095-4435-9c44-e420dfa0d131 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:29:19.724749 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2aa3bd33-9095-4435-9c44-e420dfa0d131 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 204 len: 0 microversion: 2.1 time: 0.130301 Jun 23 08:29:19.725295 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 484/958] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:29:19 2022] DELETE /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:29:19.733661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a8a5b3c6-8c5a-4839-8cb9-b79a03f53175 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:19.734323 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a8a5b3c6-8c5a-4839-8cb9-b79a03f53175 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:19.741901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a8a5b3c6-8c5a-4839-8cb9-b79a03f53175 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:19.742353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a8a5b3c6-8c5a-4839-8cb9-b79a03f53175 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:19.743152 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a8a5b3c6-8c5a-4839-8cb9-b79a03f53175 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:19.743618 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a8a5b3c6-8c5a-4839-8cb9-b79a03f53175 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:19.880306 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a8a5b3c6-8c5a-4839-8cb9-b79a03f53175 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:19.889041 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a8a5b3c6-8c5a-4839-8cb9-b79a03f53175 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1683 microversion: 2.1 time: 0.159382 Jun 23 08:29:19.889580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 475/959] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:19 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:29:20.206398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-91bdca9f-3a1a-4366-ab7f-d6e611fbdc75 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:20.206978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-91bdca9f-3a1a-4366-ab7f-d6e611fbdc75 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:20.213448 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-91bdca9f-3a1a-4366-ab7f-d6e611fbdc75 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:20.213894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-91bdca9f-3a1a-4366-ab7f-d6e611fbdc75 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:20.214656 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-91bdca9f-3a1a-4366-ab7f-d6e611fbdc75 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:20.215088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-91bdca9f-3a1a-4366-ab7f-d6e611fbdc75 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:20.240128 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-91bdca9f-3a1a-4366-ab7f-d6e611fbdc75 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:29:20.326369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-91bdca9f-3a1a-4366-ab7f-d6e611fbdc75 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 204 len: 0 microversion: 2.1 time: 0.123523 Jun 23 08:29:20.326978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 485/960] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:29:20 2022] DELETE /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:29:20.335762 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-574aec60-b175-4968-a70f-f35c8340c657 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:20.336395 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-574aec60-b175-4968-a70f-f35c8340c657 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:20.343013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-574aec60-b175-4968-a70f-f35c8340c657 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:20.343490 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-574aec60-b175-4968-a70f-f35c8340c657 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:20.344246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-574aec60-b175-4968-a70f-f35c8340c657 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:20.344686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-574aec60-b175-4968-a70f-f35c8340c657 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:20.476120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-574aec60-b175-4968-a70f-f35c8340c657 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:20.484099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-574aec60-b175-4968-a70f-f35c8340c657 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1552 microversion: 2.1 time: 0.152329 Jun 23 08:29:20.484651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 476/961] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:20 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:20.908701 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5daa829d-a769-44c9-815f-2c778bb43fa7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:20.909397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5daa829d-a769-44c9-815f-2c778bb43fa7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:20.916329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5daa829d-a769-44c9-815f-2c778bb43fa7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:20.916778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5daa829d-a769-44c9-815f-2c778bb43fa7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:20.917546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5daa829d-a769-44c9-815f-2c778bb43fa7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:20.917982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5daa829d-a769-44c9-815f-2c778bb43fa7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:21.079135 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5daa829d-a769-44c9-815f-2c778bb43fa7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:21.086864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5daa829d-a769-44c9-815f-2c778bb43fa7 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1683 microversion: 2.1 time: 0.182524 Jun 23 08:29:21.087461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 486/962] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:20 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:21.502104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7fd029d6-8c94-475a-8baa-20cb87037d1d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:21.502695 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7fd029d6-8c94-475a-8baa-20cb87037d1d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:21.510014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7fd029d6-8c94-475a-8baa-20cb87037d1d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:21.510812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7fd029d6-8c94-475a-8baa-20cb87037d1d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:21.511242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7fd029d6-8c94-475a-8baa-20cb87037d1d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:21.511670 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7fd029d6-8c94-475a-8baa-20cb87037d1d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:21.701776 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7fd029d6-8c94-475a-8baa-20cb87037d1d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:21.709818 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7fd029d6-8c94-475a-8baa-20cb87037d1d tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1552 microversion: 2.1 time: 0.211535 Jun 23 08:29:21.710497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 477/963] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:21 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:22.105754 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-04c60851-b870-44c7-ae9b-c3ddbcb0b433 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:22.106615 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-04c60851-b870-44c7-ae9b-c3ddbcb0b433 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:22.113450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-04c60851-b870-44c7-ae9b-c3ddbcb0b433 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:22.113900 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-04c60851-b870-44c7-ae9b-c3ddbcb0b433 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:22.114666 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-04c60851-b870-44c7-ae9b-c3ddbcb0b433 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:22.115099 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-04c60851-b870-44c7-ae9b-c3ddbcb0b433 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:22.120519 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:22.254716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-04c60851-b870-44c7-ae9b-c3ddbcb0b433 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:22.263136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-04c60851-b870-44c7-ae9b-c3ddbcb0b433 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1683 microversion: 2.1 time: 0.161390 Jun 23 08:29:22.263780 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 487/964] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:22 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:22.726643 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3eb7ee4d-69da-46a2-85a0-8233f39a3cd7 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:22.727236 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3eb7ee4d-69da-46a2-85a0-8233f39a3cd7 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:22.734211 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3eb7ee4d-69da-46a2-85a0-8233f39a3cd7 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:22.734750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3eb7ee4d-69da-46a2-85a0-8233f39a3cd7 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:22.735649 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3eb7ee4d-69da-46a2-85a0-8233f39a3cd7 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:22.736135 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3eb7ee4d-69da-46a2-85a0-8233f39a3cd7 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:22.880482 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3eb7ee4d-69da-46a2-85a0-8233f39a3cd7 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:22.891887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3eb7ee4d-69da-46a2-85a0-8233f39a3cd7 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1552 microversion: 2.1 time: 0.169107 Jun 23 08:29:22.892688 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 478/965] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:22 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:23.281073 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-70ff4219-2561-4a3d-84f3-7be48d3322b4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:23.281698 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-70ff4219-2561-4a3d-84f3-7be48d3322b4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:23.291760 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-70ff4219-2561-4a3d-84f3-7be48d3322b4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:23.292204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-70ff4219-2561-4a3d-84f3-7be48d3322b4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:23.293314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-70ff4219-2561-4a3d-84f3-7be48d3322b4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:23.293824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-70ff4219-2561-4a3d-84f3-7be48d3322b4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:23.439527 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-70ff4219-2561-4a3d-84f3-7be48d3322b4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:23.448522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-70ff4219-2561-4a3d-84f3-7be48d3322b4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1683 microversion: 2.1 time: 0.171450 Jun 23 08:29:23.449238 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 488/966] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:23 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:23.909386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-34b27d96-017c-4441-bc73-ed51205ddd9b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:23.910030 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-34b27d96-017c-4441-bc73-ed51205ddd9b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:23.917222 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-34b27d96-017c-4441-bc73-ed51205ddd9b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:23.917676 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-34b27d96-017c-4441-bc73-ed51205ddd9b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:23.918439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-34b27d96-017c-4441-bc73-ed51205ddd9b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:23.918864 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-34b27d96-017c-4441-bc73-ed51205ddd9b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:24.429462 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-34b27d96-017c-4441-bc73-ed51205ddd9b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c685a84382ec4f4fbd3be4378ba14ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796208f488e742d1beaef6d02f0232e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:24.437913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-34b27d96-017c-4441-bc73-ed51205ddd9b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 200 len: 1552 microversion: 2.1 time: 0.532454 Jun 23 08:29:24.438497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 479/967] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:23 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 1552 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:24.466840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9a4d36f7-6399-4a01-8fda-9ba15df8770e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:24.468549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9a4d36f7-6399-4a01-8fda-9ba15df8770e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:24.476296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9a4d36f7-6399-4a01-8fda-9ba15df8770e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:24.476746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9a4d36f7-6399-4a01-8fda-9ba15df8770e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:24.477522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9a4d36f7-6399-4a01-8fda-9ba15df8770e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:24.477954 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9a4d36f7-6399-4a01-8fda-9ba15df8770e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:24.642964 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9a4d36f7-6399-4a01-8fda-9ba15df8770e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:24.653111 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9a4d36f7-6399-4a01-8fda-9ba15df8770e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1683 microversion: 2.1 time: 0.190113 Jun 23 08:29:24.653705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 489/968] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:24 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:24.776010 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-c2b563d1-8d81-4258-8038-88b4bdb65ef5 req-e0e90cb0-738b-4477-8964-8faabdde16a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3ae113-1126-44da-8b3a-42e7f777a8c7", "name": "network-vif-deleted", "tag": "45988a1f-4c36-4aab-9724-eb0b20919aef"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:24.785986 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-c2b563d1-8d81-4258-8038-88b4bdb65ef5 req-e0e90cb0-738b-4477-8964-8faabdde16a2 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:24.786673 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-c2b563d1-8d81-4258-8038-88b4bdb65ef5 req-e0e90cb0-738b-4477-8964-8faabdde16a2 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:24.798359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-c2b563d1-8d81-4258-8038-88b4bdb65ef5 req-e0e90cb0-738b-4477-8964-8faabdde16a2 service nova] Creating event network-vif-deleted:45988a1f-4c36-4aab-9724-eb0b20919aef for instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 on hv-cinder-84721 Jun 23 08:29:24.803017 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-c2b563d1-8d81-4258-8038-88b4bdb65ef5 req-e0e90cb0-738b-4477-8964-8faabdde16a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033297 Jun 23 08:29:24.803981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 480/969] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:25.456024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:25.456742 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] [instance: ec3ae113-1126-44da-8b3a-42e7f777a8c7] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:25.465636 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:25.466461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:25.468578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:25.469640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:25.492908 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] HTTP exception thrown: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 could not be found. Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Request method failure captured: Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 HTTP/1.1 Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCNSa83HetMToBqKpLED_z6lMgWpAxfcyGDMtyTAyeQnUEo1yzIzuWPCwd7pzM-XUsuS0-nVD6JyO-XRnXLebbRSTLVbIfRw_6Yb5FSS-KD2db1C1LoHDgelAUib2zCKlKFjr0e2Xatkk2rNKufbhp1locv7IqCAuUagdKiDBqp_Zac Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 796208f488e742d1beaef6d02f0232e6 Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-TestMinimumBasicScenario-1748177594 Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:29:25.494877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_796208f488e742d1beaef6d02f0232e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/796208f488e742d1beaef6d02f0232e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/796208f488e742d1beaef6d02f0232e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/796208f488e742d1beaef6d02f0232e6"}]}] Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-TestMinimumBasicScenario-1748177594 Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 796208f488e742d1beaef6d02f0232e6 Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1748177594 Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-TestMinimumBasicScenario-1748177594-project Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: c685a84382ec4f4fbd3be4378ba14ca9 Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-TestMinimumBasicScenario-1748177594-project Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 could not be found. Jun 23 08:29:25.496259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'ec3ae113-1126-44da-8b3a-42e7f777a8c7'} Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 could not be found. Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:29:25.497024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 could not be found. Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 could not be found. Jun 23 08:29:25.498221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:25.499372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Returning 404 to user: Instance ec3ae113-1126-44da-8b3a-42e7f777a8c7 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:29:25.499372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1af0741f-9728-420b-9491-eff78dc0efa8 tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7" status: 404 len: 111 microversion: 2.1 time: 0.044433 Jun 23 08:29:25.499372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 490/970] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:25 2022] GET /compute/v2.1/servers/ec3ae113-1126-44da-8b3a-42e7f777a8c7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:29:25.514524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3b449fd9-b167-4d9a-84d3-8b16d279ba8b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] Calling method '.version_select at 0x7feb6b7e0ee0>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:25.537141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3b449fd9-b167-4d9a-84d3-8b16d279ba8b tempest-TestMinimumBasicScenario-1748177594 tempest-TestMinimumBasicScenario-1748177594-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-897008801" status: 202 len: 0 microversion: 2.1 time: 0.034511 Jun 23 08:29:25.538216 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 481/971] 10.222.0.33 () {58 vars in 1268 bytes} [Thu Jun 23 08:29:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-897008801 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:29:25.672910 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:25.673854 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:25.684161 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:25.685057 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:25.686105 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:25.706245 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:25.768094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:25.768849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:25.769541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lazy-loading 'fault' on Instance uuid 88daf008-0c99-48dd-8faf-598a50d7e968 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:29:25.855578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:25.871259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e43a91e6-12bd-418b-b545-e500c40d9f37 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 200 len: 1332 microversion: 2.1 time: 0.204306 Jun 23 08:29:25.873046 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 491/972] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:25 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 1332 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:26.826067 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-0515bd31-da97-41d5-82ef-48da0aaf38e4 req-7c559359-785c-459f-ad98-03742e3d9fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88daf008-0c99-48dd-8faf-598a50d7e968", "name": "network-vif-deleted", "tag": "6cf6bbf6-ffa9-461c-a9d8-9e14bd2e9920"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:26.837274 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-0515bd31-da97-41d5-82ef-48da0aaf38e4 req-7c559359-785c-459f-ad98-03742e3d9fec service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:26.837739 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-0515bd31-da97-41d5-82ef-48da0aaf38e4 req-7c559359-785c-459f-ad98-03742e3d9fec service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:26.848965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-0515bd31-da97-41d5-82ef-48da0aaf38e4 req-7c559359-785c-459f-ad98-03742e3d9fec service nova] Creating event network-vif-deleted:6cf6bbf6-ffa9-461c-a9d8-9e14bd2e9920 for instance 88daf008-0c99-48dd-8faf-598a50d7e968 on hv-cinder-84721 Jun 23 08:29:26.854392 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-0515bd31-da97-41d5-82ef-48da0aaf38e4 req-7c559359-785c-459f-ad98-03742e3d9fec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032561 Jun 23 08:29:26.855281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 482/973] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:26.890326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:26.891042 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:26.898336 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:26.898947 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:26.900112 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:26.900666 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:26.922434 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 HTTP/1.1 Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:29:26.924259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:29:26.926037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '88daf008-0c99-48dd-8faf-598a50d7e968'} Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:29:26.927047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:29:26.929155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:26.931880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:29:26.931880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7baa1652-9463-4735-85e1-fdfbbf217184 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 404 len: 111 microversion: 2.1 time: 0.040210 Jun 23 08:29:26.931880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 492/974] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:26 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:29:26.938306 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a6e99a06-1c9c-452f-890e-249708581078 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '.version_select at 0x7feb6b7f7b80>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:26.962384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a6e99a06-1c9c-452f-890e-249708581078 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799782136" status: 202 len: 0 microversion: 2.1 time: 0.028174 Jun 23 08:29:26.964578 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 483/975] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 23 08:29:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799782136 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:29:27.831687 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-177c19fe-8cdf-4011-82a4-9be1e288c3f9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: .version_select at 0x7feb682ffee0>, body: {"keypair": {"name": "tempest-keypair-1994888009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcJIrH3XmlKn3dzZNcPMiCprECceVPC982gFl5gXAxiF5BIOD9FfLRNPdUtWlHN9EJTHzHIGmkLNwlU5ZxQWs2q4jVCw7w+Rv0ObyfytGksH/tQM+iL685m640Ay9VKFw=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:27.847924 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-177c19fe-8cdf-4011-82a4-9be1e288c3f9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for project 4979d926d8894e3db358f16bd6bf7621. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:29:27.852538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-177c19fe-8cdf-4011-82a4-9be1e288c3f9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for user 938efacddf794fd18cd323043906b6c1 and project 4979d926d8894e3db358f16bd6bf7621. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:29:27.888342 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-177c19fe-8cdf-4011-82a4-9be1e288c3f9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060521 Jun 23 08:29:27.888961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 493/976] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:29:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:29.756645 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-394032603", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b65b84c3-0a03-45d3-ab3d-aba7b8f8cc03"}], "security_groups": [{"name": "tempest-securitygroup--1735533413"}], "key_name": "tempest-keypair-1994888009", "user_data": "}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:29.899511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] validate_networks() for [('b65b84c3-0a03-45d3-ab3d-aba7b8f8cc03', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:29:30.412437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:29:30.412862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:29:30.414268 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:29:30.414674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:29:30.415306 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:29:30.428065 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:30.428794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:30.430462 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:30.431088 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:30.452237 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for project 4979d926d8894e3db358f16bd6bf7621. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:29:30.457344 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Getting quotas for user 938efacddf794fd18cd323043906b6c1 and project 4979d926d8894e3db358f16bd6bf7621. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:29:30.471283 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:29:30.473768 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:29:30.530885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-afe9029c-13d3-43cf-87b2-cbce89038cd0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779639 Jun 23 08:29:30.531894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 484/977] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:29:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:29:30.542951 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d6336f8e-e729-4fcb-9e69-ab86e39ef0a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:30.544507 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d6336f8e-e729-4fcb-9e69-ab86e39ef0a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:30.620552 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d6336f8e-e729-4fcb-9e69-ab86e39ef0a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:30.634480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d6336f8e-e729-4fcb-9e69-ab86e39ef0a4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1241 microversion: 2.1 time: 0.096001 Jun 23 08:29:30.644740 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 494/978] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:30 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:31.654536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-741d5321-4736-4e24-9a44-8898490872b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:31.655152 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-741d5321-4736-4e24-9a44-8898490872b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:31.663539 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-741d5321-4736-4e24-9a44-8898490872b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:31.664186 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-741d5321-4736-4e24-9a44-8898490872b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:31.665146 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-741d5321-4736-4e24-9a44-8898490872b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:31.665746 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-741d5321-4736-4e24-9a44-8898490872b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:31.746128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-741d5321-4736-4e24-9a44-8898490872b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:31.749684 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:31.754930 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-741d5321-4736-4e24-9a44-8898490872b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1245 microversion: 2.1 time: 0.105970 Jun 23 08:29:31.755529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 485/979] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:31 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:32.773033 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1bc42169-c0be-4154-82ee-29cabb856621 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:32.774325 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1bc42169-c0be-4154-82ee-29cabb856621 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:32.782053 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1bc42169-c0be-4154-82ee-29cabb856621 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:32.782865 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1bc42169-c0be-4154-82ee-29cabb856621 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:32.783913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1bc42169-c0be-4154-82ee-29cabb856621 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:32.784566 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1bc42169-c0be-4154-82ee-29cabb856621 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:32.886458 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1bc42169-c0be-4154-82ee-29cabb856621 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:32.895323 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1bc42169-c0be-4154-82ee-29cabb856621 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1299 microversion: 2.1 time: 0.126981 Jun 23 08:29:32.895980 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 495/980] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:32 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:33.913664 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8edfba1c-1a8c-478c-b3ac-74d4ee6e38e0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:33.914374 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8edfba1c-1a8c-478c-b3ac-74d4ee6e38e0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:33.922355 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8edfba1c-1a8c-478c-b3ac-74d4ee6e38e0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:33.922868 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8edfba1c-1a8c-478c-b3ac-74d4ee6e38e0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:33.923748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8edfba1c-1a8c-478c-b3ac-74d4ee6e38e0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:33.924391 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8edfba1c-1a8c-478c-b3ac-74d4ee6e38e0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:34.169965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8edfba1c-1a8c-478c-b3ac-74d4ee6e38e0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:34.204153 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8edfba1c-1a8c-478c-b3ac-74d4ee6e38e0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1367 microversion: 2.1 time: 0.292699 Jun 23 08:29:34.205204 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 486/981] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:33 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:34.279678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-0c07554e-0c33-4f92-9206-62da05d873dd req-a3c9b780-7015-496d-bacc-af9980acb8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a000c32-1b71-4b9e-aa69-9299af9c49d6", "tag": "7625c9a0-7424-4648-a5cd-ef954c56958b"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:34.291707 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-0c07554e-0c33-4f92-9206-62da05d873dd req-a3c9b780-7015-496d-bacc-af9980acb8e3 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:34.292220 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-0c07554e-0c33-4f92-9206-62da05d873dd req-a3c9b780-7015-496d-bacc-af9980acb8e3 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:34.313218 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-0c07554e-0c33-4f92-9206-62da05d873dd req-a3c9b780-7015-496d-bacc-af9980acb8e3 service nova] Creating event network-changed:7625c9a0-7424-4648-a5cd-ef954c56958b for instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 on hv-cinder-84721 Jun 23 08:29:34.324397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-0c07554e-0c33-4f92-9206-62da05d873dd req-a3c9b780-7015-496d-bacc-af9980acb8e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049379 Jun 23 08:29:34.325365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 496/982] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:35.221908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-720485e6-7076-4cbb-84c1-e7df8a07d4fe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:35.222511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-720485e6-7076-4cbb-84c1-e7df8a07d4fe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:35.229635 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-720485e6-7076-4cbb-84c1-e7df8a07d4fe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:35.230082 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-720485e6-7076-4cbb-84c1-e7df8a07d4fe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:35.230847 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-720485e6-7076-4cbb-84c1-e7df8a07d4fe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:35.231304 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-720485e6-7076-4cbb-84c1-e7df8a07d4fe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:35.410527 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-720485e6-7076-4cbb-84c1-e7df8a07d4fe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:35.418278 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-720485e6-7076-4cbb-84c1-e7df8a07d4fe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1367 microversion: 2.1 time: 0.200554 Jun 23 08:29:35.418846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 487/983] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:35 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:36.440175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c707d1cd-0e9b-4403-b646-65082d01ee01 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:36.441338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c707d1cd-0e9b-4403-b646-65082d01ee01 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:36.449914 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c707d1cd-0e9b-4403-b646-65082d01ee01 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:36.450381 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c707d1cd-0e9b-4403-b646-65082d01ee01 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:36.451108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c707d1cd-0e9b-4403-b646-65082d01ee01 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:36.451706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c707d1cd-0e9b-4403-b646-65082d01ee01 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:36.587831 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c707d1cd-0e9b-4403-b646-65082d01ee01 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:36.595658 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c707d1cd-0e9b-4403-b646-65082d01ee01 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1367 microversion: 2.1 time: 0.162505 Jun 23 08:29:36.596228 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 497/984] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:36 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:37.616783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-488a8045-73b1-49e5-9a63-a15d7bab2bfc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:37.617733 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-488a8045-73b1-49e5-9a63-a15d7bab2bfc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:37.624720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-488a8045-73b1-49e5-9a63-a15d7bab2bfc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:37.625160 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-488a8045-73b1-49e5-9a63-a15d7bab2bfc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:37.625940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-488a8045-73b1-49e5-9a63-a15d7bab2bfc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:37.626360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-488a8045-73b1-49e5-9a63-a15d7bab2bfc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:37.763591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-488a8045-73b1-49e5-9a63-a15d7bab2bfc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:37.771379 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-488a8045-73b1-49e5-9a63-a15d7bab2bfc tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1367 microversion: 2.1 time: 0.160985 Jun 23 08:29:37.771942 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 488/985] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:37 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:38.513345 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-13cbe146-a196-4ba3-801b-058ea584b460 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:38.513801 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-13cbe146-a196-4ba3-801b-058ea584b460 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:38.520832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13cbe146-a196-4ba3-801b-058ea584b460 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:38.521273 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13cbe146-a196-4ba3-801b-058ea584b460 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:38.522032 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13cbe146-a196-4ba3-801b-058ea584b460 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:38.522453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13cbe146-a196-4ba3-801b-058ea584b460 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:38.545869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-13cbe146-a196-4ba3-801b-058ea584b460 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/ips" status: 200 len: 152 microversion: 2.20 time: 0.036576 Jun 23 08:29:38.546438 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 498/986] 10.222.0.33 () {60 vars in 1288 bytes} [Thu Jun 23 08:29:38 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:29:38.790376 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5e86e030-b889-40cd-b537-4c003a6c6d16 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:38.791833 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5e86e030-b889-40cd-b537-4c003a6c6d16 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:38.796038 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:38.800579 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5e86e030-b889-40cd-b537-4c003a6c6d16 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:38.801250 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5e86e030-b889-40cd-b537-4c003a6c6d16 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:38.802306 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5e86e030-b889-40cd-b537-4c003a6c6d16 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:38.803054 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5e86e030-b889-40cd-b537-4c003a6c6d16 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:38.964231 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5e86e030-b889-40cd-b537-4c003a6c6d16 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:38.972136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5e86e030-b889-40cd-b537-4c003a6c6d16 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1367 microversion: 2.1 time: 0.186400 Jun 23 08:29:38.972794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 489/987] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:38 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:29:39.992763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2581078e-ca40-46ea-aa06-ad795af113b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:39.993394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2581078e-ca40-46ea-aa06-ad795af113b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:39.997579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:40.004150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2581078e-ca40-46ea-aa06-ad795af113b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:40.004610 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2581078e-ca40-46ea-aa06-ad795af113b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:40.005366 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2581078e-ca40-46ea-aa06-ad795af113b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:40.005970 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2581078e-ca40-46ea-aa06-ad795af113b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:40.147782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2581078e-ca40-46ea-aa06-ad795af113b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:40.156276 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2581078e-ca40-46ea-aa06-ad795af113b9 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1367 microversion: 2.1 time: 0.170136 Jun 23 08:29:40.156848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 499/988] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:39 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:40.402284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0a7ffb30-36cd-475b-acd5-5f0882f73d2e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:40.402838 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0a7ffb30-36cd-475b-acd5-5f0882f73d2e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:40.409940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a7ffb30-36cd-475b-acd5-5f0882f73d2e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:40.410388 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a7ffb30-36cd-475b-acd5-5f0882f73d2e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:40.411159 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a7ffb30-36cd-475b-acd5-5f0882f73d2e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:40.411627 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0a7ffb30-36cd-475b-acd5-5f0882f73d2e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:40.434454 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-0a7ffb30-36cd-475b-acd5-5f0882f73d2e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lazy-loading 'flavor' on Instance uuid 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:29:40.444065 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:40.465137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:40.720843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0a7ffb30-36cd-475b-acd5-5f0882f73d2e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/action" status: 202 len: 0 microversion: 2.20 time: 0.322722 Jun 23 08:29:40.721477 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 490/989] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 23 08:29:40 2022] POST /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:29:40.730412 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:40.731026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:40.734072 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=6 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:40.738285 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:40.738930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:40.739929 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:40.740711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:40.872987 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:40.881491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:40.882992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:40.884208 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-685f4df3-6171-4b9b-9fbf-5cc08da0eded tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.158056 Jun 23 08:29:40.884807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 500/990] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:40 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:41.102167 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-e61db9e8-5841-42fc-bd05-5ba785bc8449 req-c586d8a1-e187-495a-a780-e7d49499ef2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a000c32-1b71-4b9e-aa69-9299af9c49d6", "name": "network-vif-plugged", "status": "completed", "tag": "7625c9a0-7424-4648-a5cd-ef954c56958b"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:41.113007 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-e61db9e8-5841-42fc-bd05-5ba785bc8449 req-c586d8a1-e187-495a-a780-e7d49499ef2c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:41.113437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-e61db9e8-5841-42fc-bd05-5ba785bc8449 req-c586d8a1-e187-495a-a780-e7d49499ef2c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:41.125597 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-e61db9e8-5841-42fc-bd05-5ba785bc8449 req-c586d8a1-e187-495a-a780-e7d49499ef2c service nova] Creating event network-vif-plugged:7625c9a0-7424-4648-a5cd-ef954c56958b for instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 on hv-cinder-84721 Jun 23 08:29:41.130447 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-e61db9e8-5841-42fc-bd05-5ba785bc8449 req-c586d8a1-e187-495a-a780-e7d49499ef2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032875 Jun 23 08:29:41.131136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 491/991] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:41.178270 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8f1aa0bd-b4b7-4f99-bacc-4131e048a25e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:41.178816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8f1aa0bd-b4b7-4f99-bacc-4131e048a25e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:41.187601 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f1aa0bd-b4b7-4f99-bacc-4131e048a25e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:41.188048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f1aa0bd-b4b7-4f99-bacc-4131e048a25e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:41.188848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f1aa0bd-b4b7-4f99-bacc-4131e048a25e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:41.189283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f1aa0bd-b4b7-4f99-bacc-4131e048a25e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:41.329956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8f1aa0bd-b4b7-4f99-bacc-4131e048a25e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:41.337710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8f1aa0bd-b4b7-4f99-bacc-4131e048a25e tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1367 microversion: 2.1 time: 0.164605 Jun 23 08:29:41.338399 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 501/992] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:41 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:41.905680 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:41.906442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:41.914157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:41.914652 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:41.915539 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:41.916022 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:42.054908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:42.063672 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:42.065602 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:42.066367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9fd9b2ee-379b-49a5-9cc0-e8c60684d86c tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.167117 Jun 23 08:29:42.067069 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 492/993] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:41 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:42.358250 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1a3990f9-1d8a-4bd4-9773-ff4dde25dc05 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:42.358857 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1a3990f9-1d8a-4bd4-9773-ff4dde25dc05 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:42.365081 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a3990f9-1d8a-4bd4-9773-ff4dde25dc05 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:42.365881 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a3990f9-1d8a-4bd4-9773-ff4dde25dc05 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:42.366641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a3990f9-1d8a-4bd4-9773-ff4dde25dc05 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:42.367073 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a3990f9-1d8a-4bd4-9773-ff4dde25dc05 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:42.505500 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1a3990f9-1d8a-4bd4-9773-ff4dde25dc05 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:42.513468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1a3990f9-1d8a-4bd4-9773-ff4dde25dc05 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1367 microversion: 2.1 time: 0.160764 Jun 23 08:29:42.514045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 502/994] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:42 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:42.786664 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-098a868b-bd83-4613-a968-1ddd1df7f1f6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:42.787251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-098a868b-bd83-4613-a968-1ddd1df7f1f6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:42.794971 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-098a868b-bd83-4613-a968-1ddd1df7f1f6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:42.795534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-098a868b-bd83-4613-a968-1ddd1df7f1f6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:42.796416 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-098a868b-bd83-4613-a968-1ddd1df7f1f6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:42.796918 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-098a868b-bd83-4613-a968-1ddd1df7f1f6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:42.823794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-098a868b-bd83-4613-a968-1ddd1df7f1f6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:29:42.921935 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-098a868b-bd83-4613-a968-1ddd1df7f1f6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "DELETE /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 204 len: 0 microversion: 2.1 time: 0.139566 Jun 23 08:29:42.922793 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 493/995] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:29:42 2022] DELETE /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:29:42.930746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9ccf9a2e-85c6-4647-b6aa-ee868ba9dc17 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:42.931387 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9ccf9a2e-85c6-4647-b6aa-ee868ba9dc17 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:42.937656 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9ccf9a2e-85c6-4647-b6aa-ee868ba9dc17 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:42.938097 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9ccf9a2e-85c6-4647-b6aa-ee868ba9dc17 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:42.938875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9ccf9a2e-85c6-4647-b6aa-ee868ba9dc17 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:42.939366 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9ccf9a2e-85c6-4647-b6aa-ee868ba9dc17 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:43.074284 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9ccf9a2e-85c6-4647-b6aa-ee868ba9dc17 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:43.082093 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9ccf9a2e-85c6-4647-b6aa-ee868ba9dc17 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1576 microversion: 2.1 time: 0.155201 Jun 23 08:29:43.082661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 503/996] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:42 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:43.086125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:43.086809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:43.096532 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:43.096986 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:43.097767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:43.098222 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:43.237742 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:43.246652 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:43.248168 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:43.249318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e3749822-7643-44f0-acda-1a8f16ea1e4e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.167459 Jun 23 08:29:43.249873 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 494/997] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:43 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:29:43.530892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0c3c53a0-fcb0-43f6-944c-8d82f8649c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:43.531539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0c3c53a0-fcb0-43f6-944c-8d82f8649c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:43.538624 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c3c53a0-fcb0-43f6-944c-8d82f8649c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:43.539069 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c3c53a0-fcb0-43f6-944c-8d82f8649c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:43.539871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c3c53a0-fcb0-43f6-944c-8d82f8649c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:43.540301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c3c53a0-fcb0-43f6-944c-8d82f8649c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:43.688854 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0c3c53a0-fcb0-43f6-944c-8d82f8649c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:43.696874 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0c3c53a0-fcb0-43f6-944c-8d82f8649c9d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1558 microversion: 2.1 time: 0.170128 Jun 23 08:29:43.697464 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 504/998] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:43 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:43.713604 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-95b778fd-854e-4b26-9f18-40524d834f5b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:43.714070 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-95b778fd-854e-4b26-9f18-40524d834f5b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:43.720451 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95b778fd-854e-4b26-9f18-40524d834f5b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:43.720893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95b778fd-854e-4b26-9f18-40524d834f5b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:43.721655 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95b778fd-854e-4b26-9f18-40524d834f5b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:43.722089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-95b778fd-854e-4b26-9f18-40524d834f5b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:43.806907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-95b778fd-854e-4b26-9f18-40524d834f5b tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097243 Jun 23 08:29:43.807796 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 495/999] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 08:29:43 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:29:44.099775 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-503fcce6-dee9-4f0e-9b98-7143f7940ed7 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:44.100421 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-503fcce6-dee9-4f0e-9b98-7143f7940ed7 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:44.107240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-503fcce6-dee9-4f0e-9b98-7143f7940ed7 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:44.107774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-503fcce6-dee9-4f0e-9b98-7143f7940ed7 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:44.108559 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-503fcce6-dee9-4f0e-9b98-7143f7940ed7 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:44.109006 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-503fcce6-dee9-4f0e-9b98-7143f7940ed7 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:44.268443 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:44.269032 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:44.275929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:44.276834 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:44.277686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:44.278193 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:44.337019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-503fcce6-dee9-4f0e-9b98-7143f7940ed7 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:44.345867 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-503fcce6-dee9-4f0e-9b98-7143f7940ed7 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1576 microversion: 2.1 time: 0.250091 Jun 23 08:29:44.346956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 505/1000] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:44 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:44.422249 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:44.430353 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:44.431970 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:44.433567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8ea94ea4-1113-419f-be71-8acd15061014 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.169707 Jun 23 08:29:44.434123 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 496/1001] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:44 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:44.860895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-3712b17a-3aa9-4f27-8161-3b181b35a456 req-08adef1e-5689-4504-a947-7eb2ad0feff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a000c32-1b71-4b9e-aa69-9299af9c49d6", "tag": "7625c9a0-7424-4648-a5cd-ef954c56958b"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:44.870164 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-3712b17a-3aa9-4f27-8161-3b181b35a456 req-08adef1e-5689-4504-a947-7eb2ad0feff1 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:44.870704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-3712b17a-3aa9-4f27-8161-3b181b35a456 req-08adef1e-5689-4504-a947-7eb2ad0feff1 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:44.882588 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-3712b17a-3aa9-4f27-8161-3b181b35a456 req-08adef1e-5689-4504-a947-7eb2ad0feff1 service nova] Creating event network-changed:7625c9a0-7424-4648-a5cd-ef954c56958b for instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 on hv-cinder-84721 Jun 23 08:29:44.888474 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-3712b17a-3aa9-4f27-8161-3b181b35a456 req-08adef1e-5689-4504-a947-7eb2ad0feff1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031223 Jun 23 08:29:44.889243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 506/1002] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:45.366303 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4b5532b8-05fb-4eb3-a26b-3982c75bfc2f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:45.366928 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4b5532b8-05fb-4eb3-a26b-3982c75bfc2f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:45.378702 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b5532b8-05fb-4eb3-a26b-3982c75bfc2f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:45.379421 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b5532b8-05fb-4eb3-a26b-3982c75bfc2f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:45.380194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b5532b8-05fb-4eb3-a26b-3982c75bfc2f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:45.380664 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b5532b8-05fb-4eb3-a26b-3982c75bfc2f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:45.452710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:45.454004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:45.460939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:45.461352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:45.462184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:45.462676 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:45.607625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:45.616320 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:45.617942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:45.619114 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2e835025-9549-47ed-b4e1-60bc8cc05277 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.170695 Jun 23 08:29:45.623270 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 507/1003] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:45 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 08:29:45.705586 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4b5532b8-05fb-4eb3-a26b-3982c75bfc2f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:45.713368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4b5532b8-05fb-4eb3-a26b-3982c75bfc2f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1576 microversion: 2.1 time: 0.353160 Jun 23 08:29:45.723651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 497/1004] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:45 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1576 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:46.485626 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-544c801b-a9c6-4121-8fa8-83f977103a04 req-025ee46c-3d59-4cc1-9392-0f4a80c725dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220cbacb-32cd-462b-b1a3-55330d9b7513", "name": "network-vif-deleted", "tag": "c6562fa6-81c6-4f29-bc56-82db2bb52c48"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:46.495780 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-544c801b-a9c6-4121-8fa8-83f977103a04 req-025ee46c-3d59-4cc1-9392-0f4a80c725dd service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:46.496574 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-544c801b-a9c6-4121-8fa8-83f977103a04 req-025ee46c-3d59-4cc1-9392-0f4a80c725dd service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:46.509799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-544c801b-a9c6-4121-8fa8-83f977103a04 req-025ee46c-3d59-4cc1-9392-0f4a80c725dd service nova] Creating event network-vif-deleted:c6562fa6-81c6-4f29-bc56-82db2bb52c48 for instance 220cbacb-32cd-462b-b1a3-55330d9b7513 on hv-cinder-84721 Jun 23 08:29:46.514973 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-544c801b-a9c6-4121-8fa8-83f977103a04 req-025ee46c-3d59-4cc1-9392-0f4a80c725dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033290 Jun 23 08:29:46.515893 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 508/1005] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:46.638572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:46.639979 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:46.648671 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:46.649154 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:46.650268 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:46.650933 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:46.733071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-13ca7d2e-78b0-4737-ac68-e8037efe2ff2 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:46.733873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-13ca7d2e-78b0-4737-ac68-e8037efe2ff2 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:46.743798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13ca7d2e-78b0-4737-ac68-e8037efe2ff2 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:46.744474 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13ca7d2e-78b0-4737-ac68-e8037efe2ff2 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:46.745345 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13ca7d2e-78b0-4737-ac68-e8037efe2ff2 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:46.745849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13ca7d2e-78b0-4737-ac68-e8037efe2ff2 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:46.751660 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:46.805657 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:46.815499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:46.817013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:46.818228 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-134fa22e-db36-4e3f-8599-f529a05fc292 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.184416 Jun 23 08:29:46.819128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 498/1006] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:46 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:46.839350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-13ca7d2e-78b0-4737-ac68-e8037efe2ff2 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:46.847356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-13ca7d2e-78b0-4737-ac68-e8037efe2ff2 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 200 len: 1223 microversion: 2.1 time: 0.119602 Jun 23 08:29:46.854979 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 509/1007] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:46 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:47.840368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:47.840950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:47.848279 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:47.848744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:47.849548 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:47.850002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:47.866580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:47.867560 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:47.874778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:47.875335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:47.876182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:47.876608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:47.892489 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] HTTP exception thrown: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Request method failure captured: Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 HTTP/1.1 Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCOsN22peIZXu4ujs2LfOP6L9I61aqS9YJ5VnPD78jZbFbpxK1qjKly35BsAjgmBXbfKhjCrUh5pUkdUDhqd4nLPTSfQWdwX591duNykQAzQYQweZEajR2xv-jkUt4nxGRusfYutqzSMIHrGI51zYeuNjTX_VHI3SHgs4Dz52ntqeyE Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:29:47.894206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa6a422103704f6d982c2bc558b3387e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}] Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-TestVolumeBootPattern-710183039 Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 8d661ea344d74681bb7206f203033c60 Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:29:47.896008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '220cbacb-32cd-462b-b1a3-55330d9b7513'} Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:29:47.897051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:29:47.898637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:29:47.900100 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Returning 404 to user: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:29:47.900100 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2d397fb6-c404-4075-b95a-4e59d10ba229 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 404 len: 111 microversion: 2.1 time: 0.034485 Jun 23 08:29:47.903468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 510/1008] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:47 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:29:47.997285 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-36805297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-5901677", "security_groups": [{"name": "tempest-secgroup-smoke-1265977529"}], "block_device_mapping_v2": [{"uuid": "8a57eeeb-6d02-4c00-a6be-e164b7b95027", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff9e8a2b-769d-4484-bac7-f1f1f8cdf548"}]}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:48.003329 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:48.006958 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:48.012483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:48.013961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:48.015121 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1a6e234f-27c3-46ca-a378-36e0962935e5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.181204 Jun 23 08:29:48.015723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 499/1009] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:47 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:48.114953 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.network.neutron [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] validate_networks() for [('ff9e8a2b-769d-4484-bac7-f1f1f8cdf548', None, None, None, None, None)] {{(pid=117758) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:29:48.507798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Flavor limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:29:48.508221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Image limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:29:48.508690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Flavor pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:29:48.509096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Image pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:29:48.509502 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:29:48.520481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:48.520927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:48.521852 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:48.522283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:48.539997 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Getting quotas for project aa6a422103704f6d982c2bc558b3387e. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:29:48.544280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Getting quotas for user 8d661ea344d74681bb7206f203033c60 and project aa6a422103704f6d982c2bc558b3387e. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:29:48.602439 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Going to run 1 instances... {{(pid=117758) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:29:48.604810 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a57eeeb-6d02-4c00-a6be-e164b7b95027',volume_size=None,volume_type=None)] {{(pid=117758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:29:48.741500 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f0a1d215-d887-4eda-8ff9-e73aed189356 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748905 Jun 23 08:29:48.742143 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 511/1010] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:29:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:29:48.753075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2facdac5-e6ff-4675-a312-b6678f497deb tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:48.753676 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2facdac5-e6ff-4675-a312-b6678f497deb tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:48.808513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2facdac5-e6ff-4675-a312-b6678f497deb tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:48.815404 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2facdac5-e6ff-4675-a312-b6678f497deb tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1090 microversion: 2.1 time: 0.066395 Jun 23 08:29:48.815976 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 500/1011] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:48 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1090 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:49.034296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:49.035014 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:49.042179 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:49.042949 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:49.043674 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:49.044199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:49.180098 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:49.189138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:49.190725 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:49.191956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-21f852de-b03f-4916-b639-d3636e693837 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.161913 Jun 23 08:29:49.192597 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 512/1012] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:49 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:49.832927 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-439ac75a-70ff-4408-a4f6-b68b072c97e9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:49.834408 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-439ac75a-70ff-4408-a4f6-b68b072c97e9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:49.846925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-439ac75a-70ff-4408-a4f6-b68b072c97e9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:49.847641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-439ac75a-70ff-4408-a4f6-b68b072c97e9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:49.848593 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-439ac75a-70ff-4408-a4f6-b68b072c97e9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:49.849180 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-439ac75a-70ff-4408-a4f6-b68b072c97e9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:49.931089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-439ac75a-70ff-4408-a4f6-b68b072c97e9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:49.938990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-439ac75a-70ff-4408-a4f6-b68b072c97e9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1206 microversion: 2.1 time: 0.110110 Jun 23 08:29:49.939584 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 501/1013] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:49 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1206 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:50.210281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:50.210895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:50.217990 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:50.218452 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:50.219180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:50.219663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:50.354635 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:50.364029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:50.365915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:50.367028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-25f58de2-bfec-4f87-9b9b-5b7b2e3f06a1 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.160769 Jun 23 08:29:50.367631 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 513/1014] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:50 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:50.955812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4aa0018e-3eeb-4fb0-8689-0bcc801bc02b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:50.956422 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4aa0018e-3eeb-4fb0-8689-0bcc801bc02b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:50.963001 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4aa0018e-3eeb-4fb0-8689-0bcc801bc02b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:50.963476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4aa0018e-3eeb-4fb0-8689-0bcc801bc02b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:50.964238 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4aa0018e-3eeb-4fb0-8689-0bcc801bc02b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:50.964724 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4aa0018e-3eeb-4fb0-8689-0bcc801bc02b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:51.183824 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4aa0018e-3eeb-4fb0-8689-0bcc801bc02b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:51.191913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4aa0018e-3eeb-4fb0-8689-0bcc801bc02b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.239950 Jun 23 08:29:51.192466 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 502/1015] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:50 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:51.307626 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-d8a6e6e8-7d69-45e3-840d-0f01220bc2fa req-f5e16da7-b2e4-45c1-98a2-3b9d9adaf0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faeb680-1bfd-4cb9-9b19-7d35d58a25fe", "tag": "396de0ea-56ae-4b2c-9466-0e228410b8bb"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:51.326762 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-d8a6e6e8-7d69-45e3-840d-0f01220bc2fa req-f5e16da7-b2e4-45c1-98a2-3b9d9adaf0db service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:51.327227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-d8a6e6e8-7d69-45e3-840d-0f01220bc2fa req-f5e16da7-b2e4-45c1-98a2-3b9d9adaf0db service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:51.346106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-d8a6e6e8-7d69-45e3-840d-0f01220bc2fa req-f5e16da7-b2e4-45c1-98a2-3b9d9adaf0db service nova] Creating event network-changed:396de0ea-56ae-4b2c-9466-0e228410b8bb for instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe on hv-cinder-84721 Jun 23 08:29:51.351558 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-d8a6e6e8-7d69-45e3-840d-0f01220bc2fa req-f5e16da7-b2e4-45c1-98a2-3b9d9adaf0db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048873 Jun 23 08:29:51.352310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 514/1016] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:51.388468 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:51.389085 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:51.395863 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:51.396567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:51.397605 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:51.398247 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:51.867362 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:51.876266 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:51.877763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:51.878957 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-38de7960-d2f9-4231-989b-3afe4cc8f975 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.495316 Jun 23 08:29:51.879555 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 503/1017] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:51 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:52.213850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4b48952f-8ffa-4aee-ae64-2c603a862e90 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:52.214888 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4b48952f-8ffa-4aee-ae64-2c603a862e90 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:52.221523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4b48952f-8ffa-4aee-ae64-2c603a862e90 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:52.222021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4b48952f-8ffa-4aee-ae64-2c603a862e90 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:52.222778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4b48952f-8ffa-4aee-ae64-2c603a862e90 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:52.223189 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4b48952f-8ffa-4aee-ae64-2c603a862e90 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:52.360513 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4b48952f-8ffa-4aee-ae64-2c603a862e90 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:52.368733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4b48952f-8ffa-4aee-ae64-2c603a862e90 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.162312 Jun 23 08:29:52.369302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 515/1018] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:52 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:52.901554 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:52.902867 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:52.913544 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:52.914272 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:52.915573 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:52.916279 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:53.138426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:53.147010 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:53.148642 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:53.149863 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e5a520cd-f343-4553-93e5-cdda9b03711f tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1745 microversion: 2.20 time: 0.254946 Jun 23 08:29:53.150427 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 504/1019] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:52 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1745 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:53.386582 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d06c7ffa-0663-451e-8717-348327812737 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:53.387770 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d06c7ffa-0663-451e-8717-348327812737 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:53.394453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d06c7ffa-0663-451e-8717-348327812737 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:53.395024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d06c7ffa-0663-451e-8717-348327812737 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:53.395986 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d06c7ffa-0663-451e-8717-348327812737 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:53.396402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d06c7ffa-0663-451e-8717-348327812737 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:53.532656 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d06c7ffa-0663-451e-8717-348327812737 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:53.541348 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d06c7ffa-0663-451e-8717-348327812737 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.159124 Jun 23 08:29:53.542233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 516/1020] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:53 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:54.171296 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:54.171861 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:54.179003 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:54.179702 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:54.180640 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:54.181223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:54.324285 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:54.332677 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:54.334169 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:54.335356 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9401af8a-ca3e-410d-9731-af946b5a62ea tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1745 microversion: 2.20 time: 0.169162 Jun 23 08:29:54.335957 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 505/1021] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:54 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:54.558663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-fcdd24cf-6ac7-4f05-a3d7-475d4b8526d6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:54.559298 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-fcdd24cf-6ac7-4f05-a3d7-475d4b8526d6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:54.566528 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fcdd24cf-6ac7-4f05-a3d7-475d4b8526d6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:54.566971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fcdd24cf-6ac7-4f05-a3d7-475d4b8526d6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:54.567761 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fcdd24cf-6ac7-4f05-a3d7-475d4b8526d6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:54.568186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-fcdd24cf-6ac7-4f05-a3d7-475d4b8526d6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:54.711185 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-fcdd24cf-6ac7-4f05-a3d7-475d4b8526d6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:54.719497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-fcdd24cf-6ac7-4f05-a3d7-475d4b8526d6 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.164790 Jun 23 08:29:54.720067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 517/1022] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:54 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:55.357896 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:55.358884 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:55.368675 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:55.369451 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:55.370556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:55.371191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:55.518601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:55.527308 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:55.528878 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:55.530025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-06f365eb-7e02-4d43-83ac-e3f98633358a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1745 microversion: 2.20 time: 0.179126 Jun 23 08:29:55.530577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 506/1023] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:55 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:55.737594 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-315f660c-5c3d-4ed3-9ddc-e3168e9bd206 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:55.738295 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-315f660c-5c3d-4ed3-9ddc-e3168e9bd206 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:55.752507 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-315f660c-5c3d-4ed3-9ddc-e3168e9bd206 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:55.752981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-315f660c-5c3d-4ed3-9ddc-e3168e9bd206 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:55.753756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-315f660c-5c3d-4ed3-9ddc-e3168e9bd206 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:55.754199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-315f660c-5c3d-4ed3-9ddc-e3168e9bd206 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:55.897508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-315f660c-5c3d-4ed3-9ddc-e3168e9bd206 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:55.905487 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-315f660c-5c3d-4ed3-9ddc-e3168e9bd206 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.171886 Jun 23 08:29:55.906057 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 518/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:55 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:56.549503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:56.550129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:56.557241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:56.557686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:56.558441 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:56.558867 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:56.696011 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:56.704561 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:56.706085 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:56.707279 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-add41fcc-c8c4-436e-8fe7-56b29c0d84bc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1745 microversion: 2.20 time: 0.161846 Jun 23 08:29:56.707850 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 507/1025] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:56 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:56.926425 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-dd1c425a-188c-413b-852e-0e68da15cb33 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:56.927156 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-dd1c425a-188c-413b-852e-0e68da15cb33 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:56.936860 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd1c425a-188c-413b-852e-0e68da15cb33 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:56.937312 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd1c425a-188c-413b-852e-0e68da15cb33 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:56.938079 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd1c425a-188c-413b-852e-0e68da15cb33 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:56.938505 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dd1c425a-188c-413b-852e-0e68da15cb33 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:57.077313 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dd1c425a-188c-413b-852e-0e68da15cb33 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:57.085263 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-dd1c425a-188c-413b-852e-0e68da15cb33 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.165187 Jun 23 08:29:57.085810 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 519/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:56 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:57.135033 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-7166cb54-db70-45fa-a548-f3d60f8299ce req-46307f71-44ad-4781-af68-a8548528611c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8439b3b6-aeb5-430a-8532-00ec6c81cbc5", "name": "network-vif-plugged", "status": "completed", "tag": "3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:29:57.144393 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-7166cb54-db70-45fa-a548-f3d60f8299ce req-46307f71-44ad-4781-af68-a8548528611c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:57.144852 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-7166cb54-db70-45fa-a548-f3d60f8299ce req-46307f71-44ad-4781-af68-a8548528611c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:57.160731 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-7166cb54-db70-45fa-a548-f3d60f8299ce req-46307f71-44ad-4781-af68-a8548528611c service nova] Creating event network-vif-plugged:3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01 for instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 on hv-cinder-84721 Jun 23 08:29:57.166206 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-7166cb54-db70-45fa-a548-f3d60f8299ce req-46307f71-44ad-4781-af68-a8548528611c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034901 Jun 23 08:29:57.167088 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 508/1027] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:29:57.729778 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:57.730812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:57.741448 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:57.742174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:57.743561 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:57.744272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:57.878831 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:57.890554 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:57.892078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:57.893256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b08b3219-10e5-495f-937d-1059d09ac111 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1745 microversion: 2.20 time: 0.170156 Jun 23 08:29:57.893813 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 520/1028] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:57 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:58.103328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-766c07f6-6271-41da-84e2-ce038552c27a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:58.104025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-766c07f6-6271-41da-84e2-ce038552c27a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:58.111649 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-766c07f6-6271-41da-84e2-ce038552c27a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:58.112096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-766c07f6-6271-41da-84e2-ce038552c27a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:58.112858 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-766c07f6-6271-41da-84e2-ce038552c27a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:58.113294 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-766c07f6-6271-41da-84e2-ce038552c27a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:58.269055 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-766c07f6-6271-41da-84e2-ce038552c27a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:58.280810 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-766c07f6-6271-41da-84e2-ce038552c27a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.182027 Jun 23 08:29:58.281390 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 509/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:58 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:29:58.916451 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:58.917475 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:58.921337 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:58.922444 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=6 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:58.933128 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:58.933874 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:58.935121 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:58.936078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:59.074224 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:59.083589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:59.085083 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:59.086258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4d66fbc1-2562-4764-acac-dfdfd51cb840 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1745 microversion: 2.20 time: 0.176413 Jun 23 08:29:59.086823 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 521/1030] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:29:58 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:29:59.300961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dd29e347-8424-455c-8b76-61a3970afe50 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:29:59.301674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dd29e347-8424-455c-8b76-61a3970afe50 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:29:59.304270 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:29:59.312577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dd29e347-8424-455c-8b76-61a3970afe50 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:59.313154 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dd29e347-8424-455c-8b76-61a3970afe50 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:59.314207 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dd29e347-8424-455c-8b76-61a3970afe50 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:29:59.314784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dd29e347-8424-455c-8b76-61a3970afe50 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:29:59.471023 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-dd29e347-8424-455c-8b76-61a3970afe50 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:29:59.479323 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dd29e347-8424-455c-8b76-61a3970afe50 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.184114 Jun 23 08:29:59.479900 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 510/1031] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:29:59 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:30:00.105543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:00.106150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:00.113498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:00.113941 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:00.114700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:00.115543 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:00.253855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:00.263445 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:00.265732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:00.266879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-256e4a3a-199a-4945-a6ba-2d626c6e40d2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1745 microversion: 2.20 time: 0.165416 Jun 23 08:30:00.267457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 522/1032] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:00 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:00.496871 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b6320ccd-6eca-42ea-bc2a-b2547fb6fcf5 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:00.497525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b6320ccd-6eca-42ea-bc2a-b2547fb6fcf5 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:00.504876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b6320ccd-6eca-42ea-bc2a-b2547fb6fcf5 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:00.505330 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b6320ccd-6eca-42ea-bc2a-b2547fb6fcf5 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:00.506096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b6320ccd-6eca-42ea-bc2a-b2547fb6fcf5 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:00.506554 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b6320ccd-6eca-42ea-bc2a-b2547fb6fcf5 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:00.642489 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b6320ccd-6eca-42ea-bc2a-b2547fb6fcf5 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:00.650132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b6320ccd-6eca-42ea-bc2a-b2547fb6fcf5 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.157448 Jun 23 08:30:00.650708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 511/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:30:00 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:30:01.286259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:01.287026 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:01.303173 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:01.304014 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:01.304917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:01.306208 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:01.456753 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:01.466006 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:01.467990 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:01.470088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-55888218-4597-4246-841c-a832a2c21127 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.188406 Jun 23 08:30:01.481991 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 523/1034] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:01 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:01.667018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-7a3f98e0-0cc0-4a23-b7aa-8c71f7775247 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:01.667822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-7a3f98e0-0cc0-4a23-b7aa-8c71f7775247 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:01.675024 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a3f98e0-0cc0-4a23-b7aa-8c71f7775247 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:01.675846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a3f98e0-0cc0-4a23-b7aa-8c71f7775247 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:01.676713 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a3f98e0-0cc0-4a23-b7aa-8c71f7775247 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:01.677240 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-7a3f98e0-0cc0-4a23-b7aa-8c71f7775247 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:01.851773 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-7a3f98e0-0cc0-4a23-b7aa-8c71f7775247 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:01.861458 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-7a3f98e0-0cc0-4a23-b7aa-8c71f7775247 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.198215 Jun 23 08:30:01.871079 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 512/1035] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:30:01 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:30:02.490749 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:02.492358 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:02.499001 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:02.499555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:02.500279 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:02.500911 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:02.669982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:02.681696 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:02.684930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:02.685373 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ea2da3c2-a429-4669-acbc-1f21507270ef tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.199623 Jun 23 08:30:02.686450 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 524/1036] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:02 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:02.880947 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-278bfe2b-ec2f-49ee-a647-ff081b9245f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:02.881965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-278bfe2b-ec2f-49ee-a647-ff081b9245f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:02.889158 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-278bfe2b-ec2f-49ee-a647-ff081b9245f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:02.889601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-278bfe2b-ec2f-49ee-a647-ff081b9245f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:02.890348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-278bfe2b-ec2f-49ee-a647-ff081b9245f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:02.890947 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-278bfe2b-ec2f-49ee-a647-ff081b9245f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:03.061143 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-278bfe2b-ec2f-49ee-a647-ff081b9245f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:03.070909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-278bfe2b-ec2f-49ee-a647-ff081b9245f3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.196062 Jun 23 08:30:03.083775 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 513/1037] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:30:02 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:30:03.242549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-8e270f5b-2a85-4a42-8f3f-82e80b38817d req-31b4fcd0-0607-4315-93a6-72567077d949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1faeb680-1bfd-4cb9-9b19-7d35d58a25fe", "name": "network-vif-plugged", "status": "completed", "tag": "396de0ea-56ae-4b2c-9466-0e228410b8bb"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:30:03.252360 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-8e270f5b-2a85-4a42-8f3f-82e80b38817d req-31b4fcd0-0607-4315-93a6-72567077d949 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:03.252828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-8e270f5b-2a85-4a42-8f3f-82e80b38817d req-31b4fcd0-0607-4315-93a6-72567077d949 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:03.269867 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-8e270f5b-2a85-4a42-8f3f-82e80b38817d req-31b4fcd0-0607-4315-93a6-72567077d949 service nova] Creating event network-vif-plugged:396de0ea-56ae-4b2c-9466-0e228410b8bb for instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe on hv-cinder-84721 Jun 23 08:30:03.280804 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-8e270f5b-2a85-4a42-8f3f-82e80b38817d req-31b4fcd0-0607-4315-93a6-72567077d949 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042655 Jun 23 08:30:03.281560 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 525/1038] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:30:03.707437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:03.708106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:03.715189 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:03.715664 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:03.716418 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:03.716846 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:03.886871 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:03.897931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:03.899453 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:03.900908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e10f7ff2-92e3-4481-afdf-ef43b7eee4a7 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.198885 Jun 23 08:30:03.901946 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 514/1039] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:03 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:04.092564 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a2177b60-f00d-47cd-8ddf-8e7838a87f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:04.094144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a2177b60-f00d-47cd-8ddf-8e7838a87f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:04.105179 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a2177b60-f00d-47cd-8ddf-8e7838a87f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:04.106324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a2177b60-f00d-47cd-8ddf-8e7838a87f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:04.108520 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a2177b60-f00d-47cd-8ddf-8e7838a87f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:04.110371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a2177b60-f00d-47cd-8ddf-8e7838a87f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:04.261916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a2177b60-f00d-47cd-8ddf-8e7838a87f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:04.270514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a2177b60-f00d-47cd-8ddf-8e7838a87f32 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.183029 Jun 23 08:30:04.271551 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 526/1040] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:30:04 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:30:04.919459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:04.920058 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:04.927194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:04.927758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:04.928743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:04.929503 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:05.074124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:05.083417 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:05.084915 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:05.086087 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cfcdadb9-fae4-44bf-a58e-774ba92662a9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.170722 Jun 23 08:30:05.086638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 515/1041] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:04 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:05.289513 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3d928a3f-9c31-4260-a9b9-9340aa282003 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:05.290283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3d928a3f-9c31-4260-a9b9-9340aa282003 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:05.297110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d928a3f-9c31-4260-a9b9-9340aa282003 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:05.297848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d928a3f-9c31-4260-a9b9-9340aa282003 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:05.298661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d928a3f-9c31-4260-a9b9-9340aa282003 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:05.299095 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d928a3f-9c31-4260-a9b9-9340aa282003 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:05.461620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3d928a3f-9c31-4260-a9b9-9340aa282003 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:05.469581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3d928a3f-9c31-4260-a9b9-9340aa282003 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1262 microversion: 2.1 time: 0.184036 Jun 23 08:30:05.471013 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 527/1042] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:30:05 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1262 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:30:06.107834 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:06.108808 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:06.119400 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:06.120240 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:06.121078 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:06.121590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:06.278248 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:06.286884 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:06.288702 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:06.290091 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4cba4cec-4410-436c-bf17-5e91a5dd436e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.188147 Jun 23 08:30:06.290645 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 516/1043] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:06 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:06.495600 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f24cd52a-f182-4b92-a6f8-5c5f5a9f1217 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:06.496995 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f24cd52a-f182-4b92-a6f8-5c5f5a9f1217 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:06.504365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f24cd52a-f182-4b92-a6f8-5c5f5a9f1217 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:06.505027 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f24cd52a-f182-4b92-a6f8-5c5f5a9f1217 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:06.505970 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f24cd52a-f182-4b92-a6f8-5c5f5a9f1217 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:06.506574 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f24cd52a-f182-4b92-a6f8-5c5f5a9f1217 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:06.528429 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:30:06.661385 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f24cd52a-f182-4b92-a6f8-5c5f5a9f1217 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:06.669334 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f24cd52a-f182-4b92-a6f8-5c5f5a9f1217 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1449 microversion: 2.1 time: 0.186082 Jun 23 08:30:06.670252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 528/1044] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:30:06 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:30:06.687029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1e064ae9-5e43-4f33-892c-fa2f3bf90509 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:06.687668 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1e064ae9-5e43-4f33-892c-fa2f3bf90509 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:06.694502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e064ae9-5e43-4f33-892c-fa2f3bf90509 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:06.694958 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e064ae9-5e43-4f33-892c-fa2f3bf90509 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:06.695765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e064ae9-5e43-4f33-892c-fa2f3bf90509 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:06.696496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e064ae9-5e43-4f33-892c-fa2f3bf90509 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:06.838723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1e064ae9-5e43-4f33-892c-fa2f3bf90509 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:06.846483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1e064ae9-5e43-4f33-892c-fa2f3bf90509 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1449 microversion: 2.1 time: 0.163707 Jun 23 08:30:06.847667 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 517/1045] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:30:06 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:30:07.310122 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:07.310728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:07.320600 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:07.327563 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:07.327563 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:07.327563 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:07.484175 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:07.502501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:07.505567 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:07.507177 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5880603e-9c8a-498e-b64c-0ccb5d7234f8 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.201511 Jun 23 08:30:07.519713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 529/1046] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:07 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:08.531480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:08.532883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:08.541183 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:08.543255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:08.544449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:08.545167 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:08.555382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:30:08.782884 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:08.806327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:08.808355 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:08.815133 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a84c3144-38c4-4f36-9d1d-b9922af6332e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.289057 Jun 23 08:30:08.829331 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 518/1047] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:08 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:08.875905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-fbf1a2ca-da80-4542-a508-f94e91e6ccc8 req-b6ed47eb-9b4e-4ddc-8027-4953eb940676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faeb680-1bfd-4cb9-9b19-7d35d58a25fe", "tag": "396de0ea-56ae-4b2c-9466-0e228410b8bb"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:30:08.887519 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-fbf1a2ca-da80-4542-a508-f94e91e6ccc8 req-b6ed47eb-9b4e-4ddc-8027-4953eb940676 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:08.888388 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-fbf1a2ca-da80-4542-a508-f94e91e6ccc8 req-b6ed47eb-9b4e-4ddc-8027-4953eb940676 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:08.904128 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-fbf1a2ca-da80-4542-a508-f94e91e6ccc8 req-b6ed47eb-9b4e-4ddc-8027-4953eb940676 service nova] Creating event network-changed:396de0ea-56ae-4b2c-9466-0e228410b8bb for instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe on hv-cinder-84721 Jun 23 08:30:08.910474 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-fbf1a2ca-da80-4542-a508-f94e91e6ccc8 req-b6ed47eb-9b4e-4ddc-8027-4953eb940676 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038322 Jun 23 08:30:08.915249 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 530/1048] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:30:09.835433 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:09.837223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:09.843056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:30:09.849129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:09.850415 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:09.852227 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:09.852990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:10.008535 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:10.018085 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:10.019937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:10.022096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8d968dfa-4179-48ff-ade7-ad4e3b1744d3 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.191904 Jun 23 08:30:10.033685 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 519/1049] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:09 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:11.042448 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:11.043953 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:11.047879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:30:11.054887 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:11.055988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:11.056995 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:11.057428 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:11.415832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:11.424408 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:11.425996 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:11.427306 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3ba6b997-ae1e-4bbe-ae53-ec1ca930f51b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1740 microversion: 2.20 time: 0.389631 Jun 23 08:30:11.428268 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 531/1050] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:11 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1740 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:12.446892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:12.447516 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:12.454560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:12.454999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:12.455879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:12.456264 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:12.596349 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:12.605410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:12.607009 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:12.608257 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1520ac67-0356-43e5-8103-cc8a98fe3ff2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1722 microversion: 2.20 time: 0.165586 Jun 23 08:30:12.608886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 520/1051] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:12 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:13.628168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:13.628850 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:13.635555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:13.635998 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:13.636755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:13.637184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:13.771692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:13.784424 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:13.785916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:13.787070 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ad29ed1f-9cd6-4935-980b-355051631c8a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1722 microversion: 2.20 time: 0.163110 Jun 23 08:30:13.787663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 532/1052] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:13 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:14.809673 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:14.810580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:14.819881 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:14.820328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:14.821076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:14.821494 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:15.017258 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:15.027434 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:15.028940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:15.030173 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d5943955-5508-4391-86d3-54a450f2d53a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1722 microversion: 2.20 time: 0.227298 Jun 23 08:30:15.030726 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 521/1053] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:14 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:16.052671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:16.053699 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:16.064871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:16.065609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:16.066586 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:16.067024 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:16.205335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:16.218212 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:16.220250 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:16.222171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ea94ca5c-9e2e-4fbe-850a-4a2a7a994749 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1665 microversion: 2.20 time: 0.176221 Jun 23 08:30:16.222736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 533/1054] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:16 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:16.240315 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e41f0cca-ff7e-4f97-8889-fe8bc6d73cfc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b5110fe-d58f-4412-b953-1c7a510981b4"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:30:16.241375 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e41f0cca-ff7e-4f97-8889-fe8bc6d73cfc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:16.248245 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e41f0cca-ff7e-4f97-8889-fe8bc6d73cfc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:16.248682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e41f0cca-ff7e-4f97-8889-fe8bc6d73cfc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:16.249427 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e41f0cca-ff7e-4f97-8889-fe8bc6d73cfc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:16.249849 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e41f0cca-ff7e-4f97-8889-fe8bc6d73cfc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:16.569734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e41f0cca-ff7e-4f97-8889-fe8bc6d73cfc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333769 Jun 23 08:30:16.570703 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 522/1055] 10.222.0.33 () {62 vars in 1363 bytes} [Thu Jun 23 08:30:16 2022] POST /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 08:30:16.692516 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ee03dd19-cfad-4ace-baa3-de7774d89136 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:16.693037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ee03dd19-cfad-4ace-baa3-de7774d89136 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:16.699706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ee03dd19-cfad-4ace-baa3-de7774d89136 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:16.700172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ee03dd19-cfad-4ace-baa3-de7774d89136 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:16.700934 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ee03dd19-cfad-4ace-baa3-de7774d89136 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:16.701366 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ee03dd19-cfad-4ace-baa3-de7774d89136 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:16.980324 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ee03dd19-cfad-4ace-baa3-de7774d89136 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/os-volume_attachments/5b5110fe-d58f-4412-b953-1c7a510981b4" status: 202 len: 0 microversion: 2.20 time: 0.292284 Jun 23 08:30:16.980967 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 534/1056] 10.222.0.33 () {60 vars in 1456 bytes} [Thu Jun 23 08:30:16 2022] DELETE /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/os-volume_attachments/5b5110fe-d58f-4412-b953-1c7a510981b4 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:30:17.037860 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dcfcd7e2-0c64-43bd-af76-8bb0235e7a68 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:30:17.038424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dcfcd7e2-0c64-43bd-af76-8bb0235e7a68 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:17.045182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dcfcd7e2-0c64-43bd-af76-8bb0235e7a68 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:17.045626 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dcfcd7e2-0c64-43bd-af76-8bb0235e7a68 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:17.046384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dcfcd7e2-0c64-43bd-af76-8bb0235e7a68 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:17.046813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dcfcd7e2-0c64-43bd-af76-8bb0235e7a68 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:17.142690 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dcfcd7e2-0c64-43bd-af76-8bb0235e7a68 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "POST /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/action" status: 202 len: 0 microversion: 2.20 time: 0.109004 Jun 23 08:30:17.143410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 523/1057] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 23 08:30:17 2022] POST /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:30:17.151616 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:17.152260 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:17.159639 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:17.160477 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:17.161145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:17.161640 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:17.288628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-fafdfa08-50e2-4a3a-a215-5f1657c53142 req-5d01e510-ae6f-4389-89d3-34c79c5607e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8439b3b6-aeb5-430a-8532-00ec6c81cbc5", "name": "network-vif-unplugged", "status": "completed", "tag": "3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:30:17.299281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-fafdfa08-50e2-4a3a-a215-5f1657c53142 req-5d01e510-ae6f-4389-89d3-34c79c5607e9 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:17.300153 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-fafdfa08-50e2-4a3a-a215-5f1657c53142 req-5d01e510-ae6f-4389-89d3-34c79c5607e9 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:17.313901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.compute.server_external_events [req-fafdfa08-50e2-4a3a-a215-5f1657c53142 req-5d01e510-ae6f-4389-89d3-34c79c5607e9 service nova] Unable to find a host for instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5. Dropping event network-vif-unplugged {{(pid=117757) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 08:30:17.314975 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-fafdfa08-50e2-4a3a-a215-5f1657c53142 req-5d01e510-ae6f-4389-89d3-34c79c5607e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031044 Jun 23 08:30:17.315809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 524/1058] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 23 08:30:17.341687 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:17.350235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:17.351827 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:17.353246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-13c4dcac-45ff-4db7-992f-69ff3c0294c6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1673 microversion: 2.20 time: 0.205660 Jun 23 08:30:17.353971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 535/1059] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:17 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:18.517534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:18.518134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:18.524566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:18.525006 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:18.525754 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:18.526178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:18.713606 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:18.721967 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:18.723689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:18.725261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-178ebc55-b785-433f-921c-f6dd1e2155d4 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.356498 Jun 23 08:30:18.726032 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 525/1060] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:18 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:19.744856 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:19.746338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:19.759580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:19.760091 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:19.761107 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:19.761695 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:19.909470 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:19.918331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:19.919923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:19.921141 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0ca5d13e-d3b5-496f-b3b1-55144112152e tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.180405 Jun 23 08:30:19.921807 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 536/1061] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:19 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:20.942040 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:20.942662 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:20.949477 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:20.950145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:20.950916 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:20.951387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:21.092638 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:21.100654 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:21.102172 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:21.103386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-09d957a8-9b08-4511-8326-a8de9bbab27d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.165366 Jun 23 08:30:21.108736 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 526/1062] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:20 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:22.121783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:22.122459 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:22.129277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:22.129712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:22.130480 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:22.130903 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:22.277815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:22.285988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:22.287958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:22.289281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-dc310004-2a98-4058-b59e-7cd4f83f944a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.171415 Jun 23 08:30:22.289930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 537/1063] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:22 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:23.308376 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:23.309813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:23.317243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:23.317953 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:23.318723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:23.319485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:23.468332 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:23.479021 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:23.480645 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:23.481898 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-39dbdb67-6073-4a8a-b611-c0be4633e596 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.178012 Jun 23 08:30:23.483062 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 527/1064] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:23 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:24.510297 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:24.511927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:24.529510 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:24.531864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:24.531864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:24.531864 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:24.682146 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:24.691010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:24.692542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:24.693769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a3c9e2c3-ca93-4bfa-887d-51eb790a4441 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.196121 Jun 23 08:30:24.694333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 538/1065] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:24 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:25.713668 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:25.714538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:25.722480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:25.722966 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:25.723769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:25.724200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:25.863252 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:25.872571 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:25.874412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:25.875686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-b57da0b4-8552-456a-ba09-20bdf3e64ef0 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.166936 Jun 23 08:30:25.876237 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 528/1066] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:25 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:26.894539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:26.895178 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:26.904645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:26.906028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:26.907202 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:26.908038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:27.047603 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:27.056365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:27.057876 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:27.059117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e593a2d3-526a-4f8f-ab94-6dd6279ee192 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.168517 Jun 23 08:30:27.059947 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 539/1067] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:26 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:28.079039 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:28.079782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:28.086755 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:28.087181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:28.088071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:28.088498 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:28.241987 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:28.250585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:28.252099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:28.253251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ed770e50-c7ce-416b-90d9-5ac3d49b9142 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.179192 Jun 23 08:30:28.253798 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 529/1068] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:28 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:29.274186 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:29.275017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:29.282781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:29.284269 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:29.285134 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:29.285596 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:29.419044 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:29.427507 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:29.429070 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:29.430280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d0612bca-87b1-47e5-8b14-1f19e1045302 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.161659 Jun 23 08:30:29.430898 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 540/1069] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:29 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:30.453859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:30.454658 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:30.463598 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:30.464049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:30.464829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:30.465391 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:30.602071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:30.615067 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:30.617360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:30.619478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a706035c-393b-4b23-88cd-96c638b4b638 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.173041 Jun 23 08:30:30.620025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 530/1070] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:30 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:31.641513 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:31.642405 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:31.652536 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:31.653237 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:31.654371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:31.655021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:31.799875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:31.808444 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:31.809972 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:31.811130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1d2e3a01-0303-403e-911a-6e669c2ccec6 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.175758 Jun 23 08:30:31.811737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 541/1071] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:31 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:32.830344 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:32.830954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:32.840474 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:32.840913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:32.841679 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:32.842106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:32.981713 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:32.985213 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:30:32.991254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:32.992775 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:32.993935 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-83346936-bd9c-4de5-8241-d0d18c43d706 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.167659 Jun 23 08:30:32.994497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 531/1072] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:32 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:34.013437 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:34.014075 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:34.021701 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:34.022168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:34.022961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:34.023453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:34.157223 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:34.165664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:34.167153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:34.168413 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1a0ff2d2-ad31-4ff5-bd4b-6728ca1c39f9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.159517 Jun 23 08:30:34.168969 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 542/1073] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:34 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:35.186675 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:35.187327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:35.194367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:35.194809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:35.195717 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:35.196142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:35.403875 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:35.412828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:35.414322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:35.415543 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8375a65c-e0a0-409f-b1a3-56b5ce486617 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.233406 Jun 23 08:30:35.416184 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 532/1074] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:35 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:36.434307 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:36.434912 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:36.441936 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:36.442387 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:36.443168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:36.443646 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:36.461316 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:30:36.581198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:36.590335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:36.592476 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:36.593694 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a396663a-b93e-42ef-b0e1-1ec7b1d0e0cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.163456 Jun 23 08:30:36.594250 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 543/1075] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:36 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:37.612137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:37.612961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:37.620220 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:37.620842 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:37.621716 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:37.622144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:37.755129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:37.764395 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:37.765821 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:37.767016 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cfd1c609-f99e-45af-a98d-0640cd02e3cc tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.158872 Jun 23 08:30:37.777969 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 533/1076] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:37 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:38.785632 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:38.786167 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:38.793465 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:38.794002 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:38.794876 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:38.795353 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:38.930737 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:38.939405 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:38.940641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:38.941812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d6050f87-4c21-4fb4-becc-213a9e3f64eb tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.160295 Jun 23 08:30:38.942720 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 544/1077] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:38 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:39.370075 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-f5b4b18a-c816-45e7-babf-a75473afa92f req-3afab2f1-aa05-4195-bd38-233c03242e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8439b3b6-aeb5-430a-8532-00ec6c81cbc5", "name": "network-vif-plugged", "status": "completed", "tag": "3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:30:39.384634 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f5b4b18a-c816-45e7-babf-a75473afa92f req-3afab2f1-aa05-4195-bd38-233c03242e97 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:39.385171 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-f5b4b18a-c816-45e7-babf-a75473afa92f req-3afab2f1-aa05-4195-bd38-233c03242e97 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:39.400330 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-f5b4b18a-c816-45e7-babf-a75473afa92f req-3afab2f1-aa05-4195-bd38-233c03242e97 service nova] Creating event network-vif-plugged:3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01 for instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 on hv-cinder-84721 Jun 23 08:30:39.406129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-f5b4b18a-c816-45e7-babf-a75473afa92f req-3afab2f1-aa05-4195-bd38-233c03242e97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039971 Jun 23 08:30:39.406719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 534/1078] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:30:39.961326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:39.961942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:39.968820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:39.969271 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:39.970035 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:39.970650 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:40.109596 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:40.118329 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:40.120002 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:40.121901 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1e74e409-b9ec-47ef-8dc7-0fa4b094ec4d tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.165014 Jun 23 08:30:40.122533 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 545/1079] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:39 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:41.141740 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:41.142492 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:41.145061 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=34 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:30:41.151493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:41.151937 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:41.153153 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:41.153843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:41.305120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:41.318113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:41.319450 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:41.320661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-64fcf861-a8c8-4c0d-bc66-16ec396c1cc5 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1731 microversion: 2.20 time: 0.183813 Jun 23 08:30:41.321387 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 535/1080] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:41 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:30:42.339269 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:30:42.339922 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:30:42.342819 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=30 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:30:42.348472 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:42.348892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:42.349670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:30:42.350101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:30:42.485531 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:42.494252 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:42.495849 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:30:42.497209 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-aecea28c-eb5b-4542-bd26-36da6f1360b2 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1718 microversion: 2.20 time: 0.161986 Jun 23 08:30:42.497785 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 546/1081] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:30:42 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:31:14.552979 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1fd98195-04da-4e64-b876-ce49c94ba124 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:14.553570 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1fd98195-04da-4e64-b876-ce49c94ba124 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:14.555566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:31:14.556223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=20 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:31:14.562501 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1fd98195-04da-4e64-b876-ce49c94ba124 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:14.562949 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1fd98195-04da-4e64-b876-ce49c94ba124 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:14.563738 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1fd98195-04da-4e64-b876-ce49c94ba124 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:14.564172 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1fd98195-04da-4e64-b876-ce49c94ba124 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:14.588575 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1fd98195-04da-4e64-b876-ce49c94ba124 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/ips" status: 200 len: 151 microversion: 2.1 time: 0.039842 Jun 23 08:31:14.589139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 536/1082] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:31:14 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:31:15.928357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1adce1cb-bf50-47ad-a03f-1d323d87d44d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "703e493c-ecdb-4478-bd47-41a38625b0aa"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:31:15.929522 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1adce1cb-bf50-47ad-a03f-1d323d87d44d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:15.931708 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:31:15.932326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=21 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:31:15.938221 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1adce1cb-bf50-47ad-a03f-1d323d87d44d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:15.938658 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1adce1cb-bf50-47ad-a03f-1d323d87d44d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:15.939452 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1adce1cb-bf50-47ad-a03f-1d323d87d44d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:15.939879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1adce1cb-bf50-47ad-a03f-1d323d87d44d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:16.223591 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1adce1cb-bf50-47ad-a03f-1d323d87d44d tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "POST /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299141 Jun 23 08:31:16.224204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 547/1083] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:31:15 2022] POST /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:31:23.870126 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-de3dfba9-7111-44ef-9642-a4393c8d0795 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:23.870743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-de3dfba9-7111-44ef-9642-a4393c8d0795 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:23.877418 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-de3dfba9-7111-44ef-9642-a4393c8d0795 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:23.877854 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-de3dfba9-7111-44ef-9642-a4393c8d0795 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:23.878605 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-de3dfba9-7111-44ef-9642-a4393c8d0795 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:23.879034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-de3dfba9-7111-44ef-9642-a4393c8d0795 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:23.965041 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-de3dfba9-7111-44ef-9642-a4393c8d0795 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lazy-loading 'services' on Instance uuid 3a000c32-1b71-4b9e-aa69-9299af9c49d6 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:31:24.052406 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-de3dfba9-7111-44ef-9642-a4393c8d0795 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-volume_attachments/703e493c-ecdb-4478-bd47-41a38625b0aa" status: 202 len: 0 microversion: 2.1 time: 0.185777 Jun 23 08:31:24.053048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 537/1084] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:31:23 2022] DELETE /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-volume_attachments/703e493c-ecdb-4478-bd47-41a38625b0aa => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 08:31:24.062791 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-976634d2-ee65-4b53-bda3-8f2df54deea8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:24.063878 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-976634d2-ee65-4b53-bda3-8f2df54deea8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:24.070661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-976634d2-ee65-4b53-bda3-8f2df54deea8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:24.071148 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-976634d2-ee65-4b53-bda3-8f2df54deea8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:24.071971 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-976634d2-ee65-4b53-bda3-8f2df54deea8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:24.072453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-976634d2-ee65-4b53-bda3-8f2df54deea8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:24.103408 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-976634d2-ee65-4b53-bda3-8f2df54deea8 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Jun 23 08:31:24.103972 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 548/1085] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:31:24 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:31:25.119331 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bb0b4e89-2f14-4ecb-870e-3d05df7411f2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:25.120733 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bb0b4e89-2f14-4ecb-870e-3d05df7411f2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:25.129019 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb0b4e89-2f14-4ecb-870e-3d05df7411f2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:25.129562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb0b4e89-2f14-4ecb-870e-3d05df7411f2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:25.130499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb0b4e89-2f14-4ecb-870e-3d05df7411f2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:25.131026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bb0b4e89-2f14-4ecb-870e-3d05df7411f2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:25.161574 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bb0b4e89-2f14-4ecb-870e-3d05df7411f2 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048757 Jun 23 08:31:25.162130 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 538/1086] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:31:25 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:31:25.222645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a677d50b-45ce-4a22-8ebe-722142c1a463 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:25.223266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a677d50b-45ce-4a22-8ebe-722142c1a463 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:25.230150 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a677d50b-45ce-4a22-8ebe-722142c1a463 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:25.230611 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a677d50b-45ce-4a22-8ebe-722142c1a463 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:25.231514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a677d50b-45ce-4a22-8ebe-722142c1a463 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:25.231950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a677d50b-45ce-4a22-8ebe-722142c1a463 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:25.257918 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a677d50b-45ce-4a22-8ebe-722142c1a463 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:31:25.343399 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a677d50b-45ce-4a22-8ebe-722142c1a463 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 204 len: 0 microversion: 2.1 time: 0.124235 Jun 23 08:31:25.344153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 549/1087] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:31:25 2022] DELETE /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:31:25.353935 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-cd529f66-d567-46e4-abb9-4607d3def008 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:25.354563 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-cd529f66-d567-46e4-abb9-4607d3def008 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:25.362154 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cd529f66-d567-46e4-abb9-4607d3def008 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:25.362597 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cd529f66-d567-46e4-abb9-4607d3def008 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:25.363400 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cd529f66-d567-46e4-abb9-4607d3def008 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:25.363829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-cd529f66-d567-46e4-abb9-4607d3def008 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:25.503787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-cd529f66-d567-46e4-abb9-4607d3def008 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:25.512004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-cd529f66-d567-46e4-abb9-4607d3def008 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1683 microversion: 2.1 time: 0.162115 Jun 23 08:31:25.512538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 539/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:31:25 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:31:26.533484 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ecd59d02-c397-40da-98bb-54832cb7b210 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:26.534296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ecd59d02-c397-40da-98bb-54832cb7b210 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:26.544000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ecd59d02-c397-40da-98bb-54832cb7b210 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:26.544441 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ecd59d02-c397-40da-98bb-54832cb7b210 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:26.545197 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ecd59d02-c397-40da-98bb-54832cb7b210 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:26.545625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ecd59d02-c397-40da-98bb-54832cb7b210 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:26.920192 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ecd59d02-c397-40da-98bb-54832cb7b210 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:26.928173 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ecd59d02-c397-40da-98bb-54832cb7b210 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1683 microversion: 2.1 time: 0.401842 Jun 23 08:31:26.928740 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 550/1089] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:31:26 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1683 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:31:27.946322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a188ec69-daa8-4d81-ac7b-1c9544065233 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:27.946917 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a188ec69-daa8-4d81-ac7b-1c9544065233 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:27.954921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a188ec69-daa8-4d81-ac7b-1c9544065233 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:27.955581 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a188ec69-daa8-4d81-ac7b-1c9544065233 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:27.956370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a188ec69-daa8-4d81-ac7b-1c9544065233 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:27.956880 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a188ec69-daa8-4d81-ac7b-1c9544065233 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:28.026960 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a188ec69-daa8-4d81-ac7b-1c9544065233 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938efacddf794fd18cd323043906b6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4979d926d8894e3db358f16bd6bf7621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:28.035309 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a188ec69-daa8-4d81-ac7b-1c9544065233 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 200 len: 1615 microversion: 2.1 time: 0.093210 Jun 23 08:31:28.035879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 540/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:31:27 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:31:28.265740 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-c47a7849-a64b-44b8-9128-a892e4fd310c req-0ecf25c3-5bb7-4918-854e-695c855dd4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a000c32-1b71-4b9e-aa69-9299af9c49d6", "name": "network-vif-deleted", "tag": "7625c9a0-7424-4648-a5cd-ef954c56958b"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:31:28.275880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c47a7849-a64b-44b8-9128-a892e4fd310c req-0ecf25c3-5bb7-4918-854e-695c855dd4d0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:28.276542 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c47a7849-a64b-44b8-9128-a892e4fd310c req-0ecf25c3-5bb7-4918-854e-695c855dd4d0 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:28.292792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-c47a7849-a64b-44b8-9128-a892e4fd310c req-0ecf25c3-5bb7-4918-854e-695c855dd4d0 service nova] Creating event network-vif-deleted:7625c9a0-7424-4648-a5cd-ef954c56958b for instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 on hv-cinder-84721 Jun 23 08:31:28.300330 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-c47a7849-a64b-44b8-9128-a892e4fd310c req-0ecf25c3-5bb7-4918-854e-695c855dd4d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119191 Jun 23 08:31:28.301981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 551/1091] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:31:29.054145 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:29.054768 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:29.062181 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:29.062717 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:29.063583 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:29.064022 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:29.078812 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 HTTP/1.1 Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:31:29.080772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:29.082585 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '3a000c32-1b71-4b9e-aa69-9299af9c49d6'} Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:29.084837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:29.087311 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:29.090727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:29.090727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e01c6970-0730-4342-80ba-503f1b31f638 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 404 len: 111 microversion: 2.1 time: 0.032326 Jun 23 08:31:29.090727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 541/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:31:29 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:29.092475 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-aa358ece-1a8f-428a-9603-3940f34e84ef tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '.version_select at 0x7feb682b9430>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:29.095879 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa358ece-1a8f-428a-9603-3940f34e84ef tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [a2ead828-aa9b-4658-a284-047d14ef7fc4] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 08:31:30.108773 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa358ece-1a8f-428a-9603-3940f34e84ef tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [a2ead828-aa9b-4658-a284-047d14ef7fc4] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 52884. Jun 23 08:31:30.135992 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-aa358ece-1a8f-428a-9603-3940f34e84ef tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994888009" status: 202 len: 0 microversion: 2.1 time: 1.048315 Jun 23 08:31:30.136583 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 552/1093] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 23 08:31:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994888009 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:31:31.916021 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:31.916581 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:31.924992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:31.925435 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:31.926216 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:31.926641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:31.943026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: DELETE /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 HTTP/1.1 Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:31:31.944631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.946275 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '3a000c32-1b71-4b9e-aa69-9299af9c49d6'} Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:31.947271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.948633 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.950487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:31.950487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a266a23c-b9b4-42d6-b14d-f895aa9cd8f4 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 404 len: 111 microversion: 2.1 time: 0.035963 Jun 23 08:31:31.950487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 542/1094] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:31:31 2022] DELETE /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:31.954930 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:31.955727 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 3a000c32-1b71-4b9e-aa69-9299af9c49d6] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:31.963633 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:31.964130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:31.964917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:31.965547 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:31.979448 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 HTTP/1.1 Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:31:31.981106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.982894 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '3a000c32-1b71-4b9e-aa69-9299af9c49d6'} Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:31.986868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. Jun 23 08:31:31.988357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:31.990501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 3a000c32-1b71-4b9e-aa69-9299af9c49d6 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:31.990501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-711f0a06-b05e-4330-8e05-1e1273681caf tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6" status: 404 len: 111 microversion: 2.1 time: 0.031861 Jun 23 08:31:31.990501 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 553/1095] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:31:31 2022] GET /compute/v2.1/servers/3a000c32-1b71-4b9e-aa69-9299af9c49d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:33.145389 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:33.145968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:33.152790 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:33.153236 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:33.154089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:33.154608 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:33.168577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: DELETE /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 HTTP/1.1 Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:31:33.170134 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.172161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '88daf008-0c99-48dd-8faf-598a50d7e968'} Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:33.173214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.174799 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.176284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:33.176284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dbf91610-1a4c-4f97-97df-0bb08b108244 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 404 len: 111 microversion: 2.1 time: 0.029976 Jun 23 08:31:33.176284 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 543/1096] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:31:33 2022] DELETE /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:33.180409 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:33.181011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 88daf008-0c99-48dd-8faf-598a50d7e968] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:33.188051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:33.188494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:33.189280 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:33.189706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:33.203749 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 HTTP/1.1 Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:31:33.205394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.207023 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '88daf008-0c99-48dd-8faf-598a50d7e968'} Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:33.208045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. Jun 23 08:31:33.209498 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.210988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 88daf008-0c99-48dd-8faf-598a50d7e968 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:33.210988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c899e9b7-82cd-40fd-830b-ab8731a83afe tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968" status: 404 len: 111 microversion: 2.1 time: 0.030643 Jun 23 08:31:33.210988 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 554/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:31:33 2022] GET /compute/v2.1/servers/88daf008-0c99-48dd-8faf-598a50d7e968 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:33.215391 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:33.215888 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:33.222490 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:33.222929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:33.223733 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:33.224156 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:33.237910 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: DELETE /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 HTTP/1.1 Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:31:33.239480 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.241368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': 'dc92fdb9-d1dd-4771-b503-766a91a813e9'} Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:33.242439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.244000 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.245758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:33.245758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-409c84f9-fd5f-4717-8a18-4a2d7a3ac63f tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 404 len: 111 microversion: 2.1 time: 0.029734 Jun 23 08:31:33.245758 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 544/1098] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:31:33 2022] DELETE /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:33.249684 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:33.250286 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: dc92fdb9-d1dd-4771-b503-766a91a813e9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:33.256471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:33.256916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:33.257694 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:33.258119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:33.271829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 HTTP/1.1 Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:31:33.273331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.275021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'dc92fdb9-d1dd-4771-b503-766a91a813e9'} Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:33.276174 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. Jun 23 08:31:33.277891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:33.282155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance dc92fdb9-d1dd-4771-b503-766a91a813e9 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:33.282155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d8caa26e-5917-426a-8ad0-ab0d7bb5a861 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9" status: 404 len: 111 microversion: 2.1 time: 0.029031 Jun 23 08:31:33.282155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 555/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:31:33 2022] GET /compute/v2.1/servers/dc92fdb9-d1dd-4771-b503-766a91a813e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:34.614344 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:34.615274 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:34.622121 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:34.622538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:34.623342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:34.623765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:34.637442 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: DELETE /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb HTTP/1.1 Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:31:34.638972 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.641090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '795dfab2-6368-40d4-bf89-95f37e857ceb'} Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:34.642137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.643661 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.645233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:34.645233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e28be6e2-cd97-4a35-b7c5-ea0f6fffd1d0 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "DELETE /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 404 len: 111 microversion: 2.1 time: 0.029934 Jun 23 08:31:34.645233 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 545/1100] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:31:34 2022] DELETE /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:34.651063 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:34.651755 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] [instance: 795dfab2-6368-40d4-bf89-95f37e857ceb] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:34.660157 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:34.660604 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:34.661357 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:34.661812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:34.675569 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] HTTP exception thrown: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Request method failure captured: Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb HTTP/1.1 Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJH8mWAavkbv5m4DG_gJU6Ow3QaPjIYLSU-VSr8VsnyKCT7QnbAe5pHQOmUrznHYpfx9pTU-N1zNN6-8jwE5mAsOS68uf5EIaZI65iqoTZfOsLmciIQCSGGsUfA8zGLop0rMI8goWHKwOxsOrNqvLIZLGFvKrnFQ9_7maJnPg52WuM Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:31:34.677071 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4979d926d8894e3db358f16bd6bf7621", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4979d926d8894e3db358f16bd6bf7621"}]}] Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 4979d926d8894e3db358f16bd6bf7621 Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-4729388 Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 938efacddf794fd18cd323043906b6c1 Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeNegativeTest-4729388-project Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.678692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '795dfab2-6368-40d4-bf89-95f37e857ceb'} Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:34.679641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. Jun 23 08:31:34.681139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:34.682468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] Returning 404 to user: Instance 795dfab2-6368-40d4-bf89-95f37e857ceb could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:34.682468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cb89e09f-1480-4c34-81b7-9f124643d281 tempest-AttachVolumeNegativeTest-4729388 tempest-AttachVolumeNegativeTest-4729388-project] 10.222.0.33 "GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb" status: 404 len: 111 microversion: 2.1 time: 0.033242 Jun 23 08:31:34.682468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 556/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:31:34 2022] GET /compute/v2.1/servers/795dfab2-6368-40d4-bf89-95f37e857ceb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:39.216485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c6a8963d-8e1c-4b30-bc7e-2ea6cf1fdaee tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Action: 'create', calling method: .version_select at 0x7feb6813a1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-729686885", "metadata": {"Type": "work"}}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c6a8963d-8e1c-4b30-bc7e-2ea6cf1fdaee tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Request method failure captured: Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 121 Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCTrk8NtjSdudnDo46rOld1OYIOls7KOW_t_l-8rSWM0mZvEJ2OUlIl-Th9FQk76BguOlCT5RjrkYWrJRHEyNpzYmy3NJ-m3fteSsHZgrNZ-r5R4WXRKiUO46yEScBgF-gw9YnL1u_jaEko_C8jTBuEjvCzBcC5qaaKDiibr5hweI0U Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:31:39.237056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb09d404c2c547bdba1beeacd86e69e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}] Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 259b1784639a471bbbcf4cd06fca1cde Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-729686885", "metadata": {"Type": "work"}}} Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: Jun 23 08:31:39.239590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-729686885', 'metadata': {'Type': 'work'}}}} Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise error Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:39.241478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 08:31:39.243989 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 08:31:39.246487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 08:31:39.246487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.246487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c6a8963d-8e1c-4b30-bc7e-2ea6cf1fdaee tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:39.246487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c6a8963d-8e1c-4b30-bc7e-2ea6cf1fdaee tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.150799 Jun 23 08:31:39.246487 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 546/1102] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 23 08:31:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:31:39.253589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-00fc5e80-413e-433a-beac-316d6155228e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Action: 'create', calling method: .version_select at 0x7feb69a9cc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-985550805", "metadata": {"Type": "work"}}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-00fc5e80-413e-433a-beac-316d6155228e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Request method failure captured: Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 119 Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCTrk8NtjSdudnDo46rOld1OYIOls7KOW_t_l-8rSWM0mZvEJ2OUlIl-Th9FQk76BguOlCT5RjrkYWrJRHEyNpzYmy3NJ-m3fteSsHZgrNZ-r5R4WXRKiUO46yEScBgF-gw9YnL1u_jaEko_C8jTBuEjvCzBcC5qaaKDiibr5hweI0U Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:31:39.256842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb09d404c2c547bdba1beeacd86e69e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}] Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 259b1784639a471bbbcf4cd06fca1cde Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-985550805", "metadata": {"Type": "work"}}} Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: Jun 23 08:31:39.258335 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-985550805', 'metadata': {'Type': 'work'}}}} Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise error Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi '0' Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:39.259377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 08:31:39.261029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 08:31:39.262311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 08:31:39.262311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.262311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-00fc5e80-413e-433a-beac-316d6155228e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:39.262311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-00fc5e80-413e-433a-beac-316d6155228e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009266 Jun 23 08:31:39.262311 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 557/1103] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 23 08:31:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:31:39.267556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-73db4648-dd07-4aa2-94ac-b4cc785b4d51 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Action: 'create', calling method: .version_select at 0x7feb68172ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-918071348", "metadata": {"Type": "work"}}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-73db4648-dd07-4aa2-94ac-b4cc785b4d51 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Request method failure captured: Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 118 Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCTrk8NtjSdudnDo46rOld1OYIOls7KOW_t_l-8rSWM0mZvEJ2OUlIl-Th9FQk76BguOlCT5RjrkYWrJRHEyNpzYmy3NJ-m3fteSsHZgrNZ-r5R4WXRKiUO46yEScBgF-gw9YnL1u_jaEko_C8jTBuEjvCzBcC5qaaKDiibr5hweI0U Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:31:39.269843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb09d404c2c547bdba1beeacd86e69e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}] Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 259b1784639a471bbbcf4cd06fca1cde Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-918071348", "metadata": {"Type": "work"}}} Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: Jun 23 08:31:39.271517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-918071348', 'metadata': {'Type': 'work'}}}} Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise error Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi '' Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:39.272476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 08:31:39.273982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 08:31:39.275290 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 08:31:39.275290 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.275290 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-73db4648-dd07-4aa2-94ac-b4cc785b4d51 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:39.275290 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-73db4648-dd07-4aa2-94ac-b4cc785b4d51 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007669 Jun 23 08:31:39.275608 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 547/1104] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 23 08:31:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:31:39.281055 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5233f078-8ed4-4246-813b-e157aadb387c tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Calling method '.version_select at 0x7feb68040dc0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:39.311994 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-5233f078-8ed4-4246-813b-e157aadb387c tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] HTTP exception thrown: Volume tempest-invalid-1410136570 could not be found. Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5233f078-8ed4-4246-813b-e157aadb387c tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Request method failure captured: Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1410136570 HTTP/1.1 Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCTrk8NtjSdudnDo46rOld1OYIOls7KOW_t_l-8rSWM0mZvEJ2OUlIl-Th9FQk76BguOlCT5RjrkYWrJRHEyNpzYmy3NJ-m3fteSsHZgrNZ-r5R4WXRKiUO46yEScBgF-gw9YnL1u_jaEko_C8jTBuEjvCzBcC5qaaKDiibr5hweI0U Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:31:39.316036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb09d404c2c547bdba1beeacd86e69e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}] Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 259b1784639a471bbbcf4cd06fca1cde Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Volume tempest-invalid-1410136570 could not be found. Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'tempest-invalid-1410136570'} Jun 23 08:31:39.318704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1410136570 could not be found. (HTTP 404) (Request-ID: req-51a2d471-e331-4a78-8978-ff26a7f78ebb) Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.320442 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 08:31:39.322766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1410136570 could not be found. Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:39.324573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1410136570 could not be found. Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1410136570 could not be found. Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5233f078-8ed4-4246-813b-e157aadb387c tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Returning 404 to user: Volume tempest-invalid-1410136570 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5233f078-8ed4-4246-813b-e157aadb387c tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1410136570" status: 404 len: 99 microversion: 2.1 time: 0.041600 Jun 23 08:31:39.326581 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 558/1105] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 23 08:31:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1410136570 => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 23 08:31:39.333051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4bab6b1f-1642-4a29-9128-b56cb8a306f6 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004113 Jun 23 08:31:39.333505 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 548/1106] 10.222.0.33 () {58 vars in 1139 bytes} [Thu Jun 23 08:31:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 08:31:39.341741 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ac8ca841-5cd1-43b7-9f75-9b4788c2d677 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003769 Jun 23 08:31:39.342259 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 559/1107] 10.222.0.33 () {58 vars in 1136 bytes} [Thu Jun 23 08:31:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 08:31:39.350148 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a3395d4b-fa2d-4cc0-bc83-db8a6506312e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Calling method '.version_select at 0x7feb68109670>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:39.380276 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-a3395d4b-fa2d-4cc0-bc83-db8a6506312e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] HTTP exception thrown: Volume 884c35d3-f46a-4125-ae59-0bc921e8492d could not be found. Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a3395d4b-fa2d-4cc0-bc83-db8a6506312e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Request method failure captured: Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: DELETE /compute/v2.1/os-volumes/884c35d3-f46a-4125-ae59-0bc921e8492d HTTP/1.1 Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCTrk8NtjSdudnDo46rOld1OYIOls7KOW_t_l-8rSWM0mZvEJ2OUlIl-Th9FQk76BguOlCT5RjrkYWrJRHEyNpzYmy3NJ-m3fteSsHZgrNZ-r5R4WXRKiUO46yEScBgF-gw9YnL1u_jaEko_C8jTBuEjvCzBcC5qaaKDiibr5hweI0U Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:31:39.383401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb09d404c2c547bdba1beeacd86e69e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}] Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 259b1784639a471bbbcf4cd06fca1cde Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Volume 884c35d3-f46a-4125-ae59-0bc921e8492d could not be found. Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '884c35d3-f46a-4125-ae59-0bc921e8492d'} Jun 23 08:31:39.384851 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 884c35d3-f46a-4125-ae59-0bc921e8492d could not be found. (HTTP 404) (Request-ID: req-3e8a9fc5-bebe-4582-a66c-87051f2c5eba) Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.385651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 08:31:39.386912 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 884c35d3-f46a-4125-ae59-0bc921e8492d could not be found. Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 08:31:39.388572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 884c35d3-f46a-4125-ae59-0bc921e8492d could not be found. Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 884c35d3-f46a-4125-ae59-0bc921e8492d could not be found. Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a3395d4b-fa2d-4cc0-bc83-db8a6506312e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Returning 404 to user: Volume 884c35d3-f46a-4125-ae59-0bc921e8492d could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a3395d4b-fa2d-4cc0-bc83-db8a6506312e tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/884c35d3-f46a-4125-ae59-0bc921e8492d" status: 404 len: 109 microversion: 2.1 time: 0.038160 Jun 23 08:31:39.390089 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 549/1108] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:31:39 2022] DELETE /compute/v2.1/os-volumes/884c35d3-f46a-4125-ae59-0bc921e8492d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:39.394603 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-86e6c51c-cc32-48df-bc7b-f1480f133988 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Calling method '.version_select at 0x7feb683601f0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:39.422038 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-86e6c51c-cc32-48df-bc7b-f1480f133988 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] HTTP exception thrown: Volume df5fa364-a6ee-4bb9-92cf-fc9377a8404b could not be found. Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-86e6c51c-cc32-48df-bc7b-f1480f133988 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Request method failure captured: Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/os-volumes/df5fa364-a6ee-4bb9-92cf-fc9377a8404b HTTP/1.1 Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCTrk8NtjSdudnDo46rOld1OYIOls7KOW_t_l-8rSWM0mZvEJ2OUlIl-Th9FQk76BguOlCT5RjrkYWrJRHEyNpzYmy3NJ-m3fteSsHZgrNZ-r5R4WXRKiUO46yEScBgF-gw9YnL1u_jaEko_C8jTBuEjvCzBcC5qaaKDiibr5hweI0U Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:31:39.424301 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb09d404c2c547bdba1beeacd86e69e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb09d404c2c547bdba1beeacd86e69e2"}]}] Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: fb09d404c2c547bdba1beeacd86e69e2 Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-VolumesNegativeTest-801397479 Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 259b1784639a471bbbcf4cd06fca1cde Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-VolumesNegativeTest-801397479-project Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Volume df5fa364-a6ee-4bb9-92cf-fc9377a8404b could not be found. Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'df5fa364-a6ee-4bb9-92cf-fc9377a8404b'} Jun 23 08:31:39.425836 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df5fa364-a6ee-4bb9-92cf-fc9377a8404b could not be found. (HTTP 404) (Request-ID: req-89ebdbe0-ddbb-4825-8239-d7620c00dc65) Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.426838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 08:31:39.428124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df5fa364-a6ee-4bb9-92cf-fc9377a8404b could not be found. Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 08:31:39.429266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df5fa364-a6ee-4bb9-92cf-fc9377a8404b could not be found. Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df5fa364-a6ee-4bb9-92cf-fc9377a8404b could not be found. Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-86e6c51c-cc32-48df-bc7b-f1480f133988 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] Returning 404 to user: Volume df5fa364-a6ee-4bb9-92cf-fc9377a8404b could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-86e6c51c-cc32-48df-bc7b-f1480f133988 tempest-VolumesNegativeTest-801397479 tempest-VolumesNegativeTest-801397479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/df5fa364-a6ee-4bb9-92cf-fc9377a8404b" status: 404 len: 109 microversion: 2.1 time: 0.035075 Jun 23 08:31:39.430420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 560/1109] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 08:31:39 2022] GET /compute/v2.1/os-volumes/df5fa364-a6ee-4bb9-92cf-fc9377a8404b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:31:49.499014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9c439440-38ea-4182-88e3-8d09c96a3fd9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:49.499994 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9c439440-38ea-4182-88e3-8d09c96a3fd9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:49.503940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=20 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:31:49.504925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:31:49.511176 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c439440-38ea-4182-88e3-8d09c96a3fd9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:49.511608 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c439440-38ea-4182-88e3-8d09c96a3fd9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:49.512373 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c439440-38ea-4182-88e3-8d09c96a3fd9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:49.512802 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9c439440-38ea-4182-88e3-8d09c96a3fd9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:49.542818 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9c439440-38ea-4182-88e3-8d09c96a3fd9 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047856 Jun 23 08:31:49.543538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 550/1110] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 23 08:31:49 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:31:49.602011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:31:49.603005 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:31:49.607745 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b3029a3d-7992-4453-a14e-1f83da1c01cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:49.608235 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b3029a3d-7992-4453-a14e-1f83da1c01cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:49.616073 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b3029a3d-7992-4453-a14e-1f83da1c01cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:49.616587 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b3029a3d-7992-4453-a14e-1f83da1c01cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:49.617524 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b3029a3d-7992-4453-a14e-1f83da1c01cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:49.617952 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b3029a3d-7992-4453-a14e-1f83da1c01cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:49.645184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b3029a3d-7992-4453-a14e-1f83da1c01cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Going to try to terminate instance {{(pid=117758) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:31:49.724969 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b3029a3d-7992-4453-a14e-1f83da1c01cd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 204 len: 0 microversion: 2.20 time: 0.123935 Jun 23 08:31:49.725757 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 561/1111] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 23 08:31:49 2022] DELETE /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 08:31:49.734885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:49.735520 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:49.742288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:49.742959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:49.743748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:49.744199 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:49.882711 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:49.890885 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:49.893140 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:49.894343 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ec931c69-d34f-4318-961d-94d694f66725 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.164182 Jun 23 08:31:49.899517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 551/1112] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:31:49 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:31:50.913895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:50.914580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:50.921934 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:50.922380 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:50.923189 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:50.923943 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:51.070338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:51.078897 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:51.080760 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:51.081953 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-be850f7a-8a98-4cda-a921-ef33bae2ee50 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1724 microversion: 2.20 time: 0.172519 Jun 23 08:31:51.082532 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 562/1113] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:31:50 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:31:52.101113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:52.101690 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:52.108445 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:52.108880 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:52.109630 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:52.110058 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:52.178748 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:52.187227 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:52.188735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:52.190631 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6321fc95-54bd-4cc3-8e32-3d71a7bf553a tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1657 microversion: 2.20 time: 0.093529 Jun 23 08:31:52.191218 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 552/1114] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:31:52 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:31:52.335296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-45fa77dc-cc0c-49da-a467-9b888276354f req-b773c3eb-e2d7-4ad8-bafa-4c674e2a0cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8439b3b6-aeb5-430a-8532-00ec6c81cbc5", "name": "network-vif-deleted", "tag": "3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:31:52.344773 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-45fa77dc-cc0c-49da-a467-9b888276354f req-b773c3eb-e2d7-4ad8-bafa-4c674e2a0cb5 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:52.345204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-45fa77dc-cc0c-49da-a467-9b888276354f req-b773c3eb-e2d7-4ad8-bafa-4c674e2a0cb5 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:52.356630 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-45fa77dc-cc0c-49da-a467-9b888276354f req-b773c3eb-e2d7-4ad8-bafa-4c674e2a0cb5 service nova] Creating event network-vif-deleted:3b89ba5b-cfa5-49ac-9236-d2feb4c5ab01 for instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 on hv-cinder-84721 Jun 23 08:31:52.362187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-45fa77dc-cc0c-49da-a467-9b888276354f req-b773c3eb-e2d7-4ad8-bafa-4c674e2a0cb5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030521 Jun 23 08:31:52.363107 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 563/1115] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:31:53.210001 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:53.210592 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:53.216789 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:53.217224 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:53.217979 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:53.218385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:53.286887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:53.296335 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:53.297871 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:53.299109 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3d30602e-e5f9-4828-91f0-17dce7c62c19 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1367 microversion: 2.20 time: 0.093718 Jun 23 08:31:53.299684 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 553/1116] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:31:53 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:31:54.318565 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:54.319412 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:54.326237 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:54.326676 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:54.327481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:54.327908 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:54.390272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:54.398383 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:54.399911 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:54.401039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4b4e8f57-4be9-4a9e-8f6b-195b4a4fb8be tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1367 microversion: 2.20 time: 0.087446 Jun 23 08:31:54.401599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 564/1117] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:31:54 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:31:55.419520 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:55.420122 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:55.426750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:55.427200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:55.427988 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:55.428396 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:55.460163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:55.460609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:55.461051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lazy-loading 'fault' on Instance uuid 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:31:55.502622 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:55.511035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:55.512576 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b178568bc5e4876bdab388ac3302f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89774ed6e4964866bf6fd73e32dee267', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:31:55.513734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8657dc6d-3387-41d3-8bc5-c08ae0439cdd tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 200 len: 1372 microversion: 2.20 time: 0.098306 Jun 23 08:31:55.514286 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 554/1118] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:31:55 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 08:31:56.532716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:56.533318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:31:56.540347 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:56.540793 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:56.541661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:31:56.542094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:31:56.555759 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] HTTP exception thrown: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Request method failure captured: Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 HTTP/1.1 Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJBDlTr7vxIc_OETwId0KuxRkrIiVjVdCoYmGPbwoTtrirWnCZ_7OefeNnksF6QrMX5h6CJ2aGh0qAOX6NrBK2soHL7i8TztG-4WP8usy8DjMSIGQkblmiUIl1b2Oo7nkirvpCMJd_ZJaLsyqMogJhWwI0aJpXDzRUJxsycytxZjCw Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:31:56.557406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89774ed6e4964866bf6fd73e32dee267", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}] Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 9b178568bc5e4876bdab388ac3302f0a Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:31:56.558913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '8439b3b6-aeb5-430a-8532-00ec6c81cbc5'} Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:31:56.559750 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:31:56.561154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:31:56.562625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Returning 404 to user: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:31:56.562625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2f6aae99-18e0-43eb-96bf-bc9c8ec3ed49 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 404 len: 111 microversion: 2.20 time: 0.030092 Jun 23 08:31:56.562625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 565/1119] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:31:56 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:31:56.569048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c9545e69-03e1-49c4-b8b3-f8857fdf135b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '.version_select at 0x7feb681e2310>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:31:56.588548 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c9545e69-03e1-49c4-b8b3-f8857fdf135b tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463437148" status: 204 len: 0 microversion: 2.20 time: 0.024461 Jun 23 08:31:56.589253 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 555/1120] 10.222.0.33 () {60 vars in 1261 bytes} [Thu Jun 23 08:31:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463437148 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 08:32:02.604327 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:02.604910 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:02.612566 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:02.613164 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:02.614147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:02.614622 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:02.629036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] HTTP exception thrown: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Request method failure captured: Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 HTTP/1.1 Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJBDlTr7vxIc_OETwId0KuxRkrIiVjVdCoYmGPbwoTtrirWnCZ_7OefeNnksF6QrMX5h6CJ2aGh0qAOX6NrBK2soHL7i8TztG-4WP8usy8DjMSIGQkblmiUIl1b2Oo7nkirvpCMJd_ZJaLsyqMogJhWwI0aJpXDzRUJxsycytxZjCw Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:32:02.630620 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89774ed6e4964866bf6fd73e32dee267", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}] Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 9b178568bc5e4876bdab388ac3302f0a Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.632714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '8439b3b6-aeb5-430a-8532-00ec6c81cbc5'} Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:32:02.633641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.635240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.636820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Returning 404 to user: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:32:02.636820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f5298535-1c83-4dc2-b5f3-dc60820ebf56 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 404 len: 111 microversion: 2.20 time: 0.031864 Jun 23 08:32:02.636820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 566/1121] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 23 08:32:02 2022] DELETE /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:32:02.646136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:02.646741 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: 8439b3b6-aeb5-430a-8532-00ec6c81cbc5] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:02.653802 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:02.654239 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:02.654983 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:02.655493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:02.668927 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] HTTP exception thrown: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Request method failure captured: Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 HTTP/1.1 Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJBDlTr7vxIc_OETwId0KuxRkrIiVjVdCoYmGPbwoTtrirWnCZ_7OefeNnksF6QrMX5h6CJ2aGh0qAOX6NrBK2soHL7i8TztG-4WP8usy8DjMSIGQkblmiUIl1b2Oo7nkirvpCMJd_ZJaLsyqMogJhWwI0aJpXDzRUJxsycytxZjCw Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:32:02.670470 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89774ed6e4964866bf6fd73e32dee267", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}] Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 9b178568bc5e4876bdab388ac3302f0a Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.672128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '8439b3b6-aeb5-430a-8532-00ec6c81cbc5'} Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:32:02.672959 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. Jun 23 08:32:02.674217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:02.675380 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Returning 404 to user: Instance 8439b3b6-aeb5-430a-8532-00ec6c81cbc5 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:32:02.675380 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c5180767-7fa5-4fa4-8504-871e69fa4401 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5" status: 404 len: 111 microversion: 2.20 time: 0.030389 Jun 23 08:32:02.675380 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 556/1122] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:32:02 2022] GET /compute/v2.1/servers/8439b3b6-aeb5-430a-8532-00ec6c81cbc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:32:03.824502 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:03.825057 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:03.831919 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:03.832365 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:03.833128 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:03.833557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:03.847677 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] HTTP exception thrown: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Request method failure captured: Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 HTTP/1.1 Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCJBDlTr7vxIc_OETwId0KuxRkrIiVjVdCoYmGPbwoTtrirWnCZ_7OefeNnksF6QrMX5h6CJ2aGh0qAOX6NrBK2soHL7i8TztG-4WP8usy8DjMSIGQkblmiUIl1b2Oo7nkirvpCMJd_ZJaLsyqMogJhWwI0aJpXDzRUJxsycytxZjCw Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:32:03.849227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89774ed6e4964866bf6fd73e32dee267", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}] Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 9b178568bc5e4876bdab388ac3302f0a Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.850948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'a62a72a3-1376-4284-94a0-d57fbe81f1b9'} Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:32:03.851789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.853258 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.854861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Returning 404 to user: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:32:03.854861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d6be03b8-8bfd-4a33-8377-7365675f3068 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 404 len: 111 microversion: 2.20 time: 0.030383 Jun 23 08:32:03.854861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 567/1123] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 23 08:32:03 2022] DELETE /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:32:03.859644 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:03.860241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] [instance: a62a72a3-1376-4284-94a0-d57fbe81f1b9] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:03.867492 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:03.867931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:03.868701 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:03.869123 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:03.883142 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] HTTP exception thrown: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Request method failure captured: Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 HTTP/1.1 Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCJBDlTr7vxIc_OETwId0KuxRkrIiVjVdCoYmGPbwoTtrirWnCZ_7OefeNnksF6QrMX5h6CJ2aGh0qAOX6NrBK2soHL7i8TztG-4WP8usy8DjMSIGQkblmiUIl1b2Oo7nkirvpCMJd_ZJaLsyqMogJhWwI0aJpXDzRUJxsycytxZjCw Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:32:03.884727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89774ed6e4964866bf6fd73e32dee267", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89774ed6e4964866bf6fd73e32dee267"}]}] Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: 89774ed6e4964866bf6fd73e32dee267 Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558230700 Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 9b178568bc5e4876bdab388ac3302f0a Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558230700-project Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.886403 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': 'a62a72a3-1376-4284-94a0-d57fbe81f1b9'} Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:32:03.887367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. Jun 23 08:32:03.888894 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:32:03.890241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] Returning 404 to user: Instance a62a72a3-1376-4284-94a0-d57fbe81f1b9 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:32:03.890241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-856bd938-ff19-4b6a-96e8-0e2761ee4843 tempest-AttachVolumeShelveTestJSON-558230700 tempest-AttachVolumeShelveTestJSON-558230700-project] 10.222.0.33 "GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9" status: 404 len: 111 microversion: 2.20 time: 0.030470 Jun 23 08:32:03.890241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 557/1124] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 08:32:03 2022] GET /compute/v2.1/servers/a62a72a3-1376-4284-94a0-d57fbe81f1b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 08:32:12.890848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-363e9bc5-dbad-4d83-b96a-1bd2db75db26 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'create', calling method: .version_select at 0x7feb62f988b0>, body: {"keypair": {"name": "tempest-keypair-501743413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtM1/kGotwjaXRie1NpVjagalfJJ0G4FnRRY5rabBPTrFgZWtyym3fkA4WVFSsq9YzZGnGAlLc2ZNUURYJiSPeFZ9FS0hpzLyuNUVoRraUGcJb2PhXtWgdLx6uABb6pYA=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:12.905199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-363e9bc5-dbad-4d83-b96a-1bd2db75db26 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Getting quotas for project e27862b1b0f2434d86d6af9998716432. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:32:12.909160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-363e9bc5-dbad-4d83-b96a-1bd2db75db26 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Getting quotas for user 4ab1ccac328d47c99119b8205cabfedd and project e27862b1b0f2434d86d6af9998716432. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:32:12.934170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-363e9bc5-dbad-4d83-b96a-1bd2db75db26 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166005 Jun 23 08:32:12.935782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 568/1125] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:32:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:32:14.220329 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1642009899", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7266267-7981-404f-999b-51d6ce27aceb"}], "security_groups": [{"name": "tempest-securitygroup--697302945"}], "key_name": "tempest-keypair-501743413", "user_data": "}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:14.228010 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:14.229050 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=36 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:14.352564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] validate_networks() for [('b7266267-7981-404f-999b-51d6ce27aceb', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:32:14.891786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:32:14.892205 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:32:14.893138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:32:14.893551 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:32:14.893962 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:32:14.905265 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:14.905714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:14.906558 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:14.906941 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:14.934174 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Getting quotas for project e27862b1b0f2434d86d6af9998716432. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:32:14.939544 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Getting quotas for user 4ab1ccac328d47c99119b8205cabfedd and project e27862b1b0f2434d86d6af9998716432. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:32:14.953220 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:32:14.955561 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:32:15.015555 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c5200ad4-ee16-4755-acd1-23181c524359 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.799555 Jun 23 08:32:15.016755 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 558/1126] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:32:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:32:15.023790 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:15.029927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cce491e9-39e4-46ea-ae09-13ce7866ad1b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:15.030926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cce491e9-39e4-46ea-ae09-13ce7866ad1b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:15.117238 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cce491e9-39e4-46ea-ae09-13ce7866ad1b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:15.127682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cce491e9-39e4-46ea-ae09-13ce7866ad1b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1237 microversion: 2.1 time: 0.105117 Jun 23 08:32:15.128957 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 569/1127] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:15 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:16.144943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0c428793-8e6f-4eb9-b604-e562891e9343 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:16.145562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0c428793-8e6f-4eb9-b604-e562891e9343 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:16.153903 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c428793-8e6f-4eb9-b604-e562891e9343 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:16.154331 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c428793-8e6f-4eb9-b604-e562891e9343 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:16.155144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c428793-8e6f-4eb9-b604-e562891e9343 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:16.155669 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0c428793-8e6f-4eb9-b604-e562891e9343 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:16.235857 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0c428793-8e6f-4eb9-b604-e562891e9343 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:16.246950 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0c428793-8e6f-4eb9-b604-e562891e9343 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1241 microversion: 2.1 time: 0.106040 Jun 23 08:32:16.247567 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 559/1128] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:16 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:17.266380 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ea632ad2-be57-40e2-98cb-6b4d2429d76e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:17.267239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ea632ad2-be57-40e2-98cb-6b4d2429d76e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:17.276128 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea632ad2-be57-40e2-98cb-6b4d2429d76e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:17.276563 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea632ad2-be57-40e2-98cb-6b4d2429d76e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:17.277372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea632ad2-be57-40e2-98cb-6b4d2429d76e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:17.277810 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ea632ad2-be57-40e2-98cb-6b4d2429d76e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:17.341302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ea632ad2-be57-40e2-98cb-6b4d2429d76e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:17.355508 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ea632ad2-be57-40e2-98cb-6b4d2429d76e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1241 microversion: 2.1 time: 0.093645 Jun 23 08:32:17.356999 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 570/1129] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:17 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:18.374568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9190bcc8-6c42-4405-aa13-2650169de438 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:18.375157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9190bcc8-6c42-4405-aa13-2650169de438 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:18.382449 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9190bcc8-6c42-4405-aa13-2650169de438 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:18.382892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9190bcc8-6c42-4405-aa13-2650169de438 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:18.383763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9190bcc8-6c42-4405-aa13-2650169de438 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:18.384221 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9190bcc8-6c42-4405-aa13-2650169de438 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:18.472178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9190bcc8-6c42-4405-aa13-2650169de438 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:18.488128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9190bcc8-6c42-4405-aa13-2650169de438 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1295 microversion: 2.1 time: 0.114247 Jun 23 08:32:18.488128 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 560/1130] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:18 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1295 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:19.502690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-767cb50d-7ba5-4f58-a251-a7e1b5b239c9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:19.503396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-767cb50d-7ba5-4f58-a251-a7e1b5b239c9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:19.512546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-767cb50d-7ba5-4f58-a251-a7e1b5b239c9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:19.513467 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-767cb50d-7ba5-4f58-a251-a7e1b5b239c9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:19.514529 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-767cb50d-7ba5-4f58-a251-a7e1b5b239c9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:19.515118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-767cb50d-7ba5-4f58-a251-a7e1b5b239c9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:19.660756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-767cb50d-7ba5-4f58-a251-a7e1b5b239c9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:19.669530 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-767cb50d-7ba5-4f58-a251-a7e1b5b239c9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.171026 Jun 23 08:32:19.670129 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 571/1131] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:19 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:19.728968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-dee01b20-f99b-487c-b2b8-58f1d2cfbc1b req-200a08d5-cc95-4719-a530-f063d4f763fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23522f32-f998-4da9-becd-a9025e7aa51f", "tag": "7cb06001-8150-4b24-a798-8cf3df9b607b"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:19.745757 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-dee01b20-f99b-487c-b2b8-58f1d2cfbc1b req-200a08d5-cc95-4719-a530-f063d4f763fe service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:19.746198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-dee01b20-f99b-487c-b2b8-58f1d2cfbc1b req-200a08d5-cc95-4719-a530-f063d4f763fe service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:19.760120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-dee01b20-f99b-487c-b2b8-58f1d2cfbc1b req-200a08d5-cc95-4719-a530-f063d4f763fe service nova] Creating event network-changed:7cb06001-8150-4b24-a798-8cf3df9b607b for instance 23522f32-f998-4da9-becd-a9025e7aa51f on hv-cinder-84721 Jun 23 08:32:19.765890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-dee01b20-f99b-487c-b2b8-58f1d2cfbc1b req-200a08d5-cc95-4719-a530-f063d4f763fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043434 Jun 23 08:32:19.767182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 561/1132] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:32:20.691189 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a731fb70-56ce-43e8-bb51-e125e5d5eed1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:20.692239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a731fb70-56ce-43e8-bb51-e125e5d5eed1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:20.695916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:20.702604 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a731fb70-56ce-43e8-bb51-e125e5d5eed1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:20.703047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a731fb70-56ce-43e8-bb51-e125e5d5eed1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:20.703947 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a731fb70-56ce-43e8-bb51-e125e5d5eed1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:20.704372 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a731fb70-56ce-43e8-bb51-e125e5d5eed1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:20.843602 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a731fb70-56ce-43e8-bb51-e125e5d5eed1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:20.851242 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a731fb70-56ce-43e8-bb51-e125e5d5eed1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.166839 Jun 23 08:32:20.851911 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 572/1133] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:20 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:21.872162 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-442dd088-2a06-41e4-bee9-99b0894f776d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:21.872915 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-442dd088-2a06-41e4-bee9-99b0894f776d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:21.879806 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-442dd088-2a06-41e4-bee9-99b0894f776d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:21.880250 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-442dd088-2a06-41e4-bee9-99b0894f776d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:21.881035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-442dd088-2a06-41e4-bee9-99b0894f776d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:21.881464 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-442dd088-2a06-41e4-bee9-99b0894f776d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:22.026119 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-442dd088-2a06-41e4-bee9-99b0894f776d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:22.033679 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-442dd088-2a06-41e4-bee9-99b0894f776d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.168016 Jun 23 08:32:22.034243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 562/1134] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:21 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:23.054589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1de4a58f-568d-41d1-809e-e53747558fdf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:23.055622 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1de4a58f-568d-41d1-809e-e53747558fdf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:23.063169 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1de4a58f-568d-41d1-809e-e53747558fdf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:23.063644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1de4a58f-568d-41d1-809e-e53747558fdf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:23.064404 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1de4a58f-568d-41d1-809e-e53747558fdf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:23.064829 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1de4a58f-568d-41d1-809e-e53747558fdf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:23.203659 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1de4a58f-568d-41d1-809e-e53747558fdf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:23.212656 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1de4a58f-568d-41d1-809e-e53747558fdf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.164372 Jun 23 08:32:23.213298 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 573/1135] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:23 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:24.229829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5f56ef52-c76f-4152-b977-f8514e844fa9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:24.230907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5f56ef52-c76f-4152-b977-f8514e844fa9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:24.237995 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5f56ef52-c76f-4152-b977-f8514e844fa9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:24.238435 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5f56ef52-c76f-4152-b977-f8514e844fa9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:24.239358 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5f56ef52-c76f-4152-b977-f8514e844fa9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:24.239753 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5f56ef52-c76f-4152-b977-f8514e844fa9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:24.370642 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-5f56ef52-c76f-4152-b977-f8514e844fa9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:24.378254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5f56ef52-c76f-4152-b977-f8514e844fa9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.152344 Jun 23 08:32:24.378813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 563/1136] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:24 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:24.396390 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-515801385", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-5901677", "security_groups": [{"name": "tempest-secgroup-smoke-1265977529"}], "block_device_mapping_v2": [{"uuid": "91645289-6150-4c8a-9622-05fd9630b82d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff9e8a2b-769d-4484-bac7-f1f1f8cdf548"}]}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:24.511047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.network.neutron [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] validate_networks() for [('ff9e8a2b-769d-4484-bac7-f1f1f8cdf548', None, None, None, None, None)] {{(pid=117758) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:32:24.949518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Flavor limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:32:24.949941 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Image limits 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:32:24.950416 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Flavor pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:32:24.950824 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Image pref 0:0:0 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:32:24.951257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.virt.hardware [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117758) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:32:24.961041 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:24.961488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:24.962289 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:24.962726 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:24.980106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Getting quotas for project aa6a422103704f6d982c2bc558b3387e. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:32:24.984962 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Getting quotas for user 8d661ea344d74681bb7206f203033c60 and project aa6a422103704f6d982c2bc558b3387e. Resources: {'ram', 'cores', 'instances'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:32:25.044453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Going to run 1 instances... {{(pid=117758) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:32:25.046585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91645289-6150-4c8a-9622-05fd9630b82d',volume_size=None,volume_type=None)] {{(pid=117758) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:32:25.182060 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e6c7ad73-53b2-44c5-a40b-79ef9ece9d5a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789491 Jun 23 08:32:25.182700 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 574/1137] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:32:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:32:25.192767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2de5be1e-adc4-4933-8e19-bb5803852f99 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:25.193381 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2de5be1e-adc4-4933-8e19-bb5803852f99 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:25.195402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:25.196074 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:25.249229 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2de5be1e-adc4-4933-8e19-bb5803852f99 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:25.256076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2de5be1e-adc4-4933-8e19-bb5803852f99 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1091 microversion: 2.1 time: 0.067139 Jun 23 08:32:25.256829 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 564/1138] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:25 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1091 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:25.395585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-22c85c5f-bef9-46fc-80e8-266e32330c05 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:25.396283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-22c85c5f-bef9-46fc-80e8-266e32330c05 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:25.403037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-22c85c5f-bef9-46fc-80e8-266e32330c05 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:25.403730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-22c85c5f-bef9-46fc-80e8-266e32330c05 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:25.404257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-22c85c5f-bef9-46fc-80e8-266e32330c05 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:25.404663 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-22c85c5f-bef9-46fc-80e8-266e32330c05 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:25.542704 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-22c85c5f-bef9-46fc-80e8-266e32330c05 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:25.550531 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-22c85c5f-bef9-46fc-80e8-266e32330c05 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.159111 Jun 23 08:32:25.551108 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 575/1139] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:25 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:26.273289 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-f7338d26-c9a5-4cce-83cc-148ae5698347 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:26.273892 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-f7338d26-c9a5-4cce-83cc-148ae5698347 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:26.281205 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f7338d26-c9a5-4cce-83cc-148ae5698347 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:26.281651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f7338d26-c9a5-4cce-83cc-148ae5698347 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:26.282409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f7338d26-c9a5-4cce-83cc-148ae5698347 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:26.282837 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-f7338d26-c9a5-4cce-83cc-148ae5698347 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:26.352392 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-f7338d26-c9a5-4cce-83cc-148ae5698347 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:26.360402 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-f7338d26-c9a5-4cce-83cc-148ae5698347 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1141 microversion: 2.1 time: 0.091068 Jun 23 08:32:26.360978 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 565/1140] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:26 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1141 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:26.569506 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cda9170d-4b63-4d68-b854-6e94aaea244d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:26.570426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cda9170d-4b63-4d68-b854-6e94aaea244d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:26.579398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cda9170d-4b63-4d68-b854-6e94aaea244d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:26.579847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cda9170d-4b63-4d68-b854-6e94aaea244d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:26.580609 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cda9170d-4b63-4d68-b854-6e94aaea244d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:26.581050 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cda9170d-4b63-4d68-b854-6e94aaea244d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:26.730558 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cda9170d-4b63-4d68-b854-6e94aaea244d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:26.743843 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cda9170d-4b63-4d68-b854-6e94aaea244d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.179615 Jun 23 08:32:26.744742 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 576/1141] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:26 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:27.383774 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4d6b423c-50ee-4a8a-9546-7df9dfa2e6aa tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:27.384896 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4d6b423c-50ee-4a8a-9546-7df9dfa2e6aa tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:27.393027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4d6b423c-50ee-4a8a-9546-7df9dfa2e6aa tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:27.393467 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4d6b423c-50ee-4a8a-9546-7df9dfa2e6aa tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:27.394216 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4d6b423c-50ee-4a8a-9546-7df9dfa2e6aa tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:27.394672 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4d6b423c-50ee-4a8a-9546-7df9dfa2e6aa tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:27.455424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4d6b423c-50ee-4a8a-9546-7df9dfa2e6aa tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:27.463155 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4d6b423c-50ee-4a8a-9546-7df9dfa2e6aa tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1141 microversion: 2.1 time: 0.087538 Jun 23 08:32:27.463760 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 566/1142] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:27 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1141 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:27.762791 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-efcb2747-a054-4467-97bb-be606c8a5d60 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:27.763478 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-efcb2747-a054-4467-97bb-be606c8a5d60 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:27.770660 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-efcb2747-a054-4467-97bb-be606c8a5d60 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:27.771497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-efcb2747-a054-4467-97bb-be606c8a5d60 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:27.772413 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-efcb2747-a054-4467-97bb-be606c8a5d60 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:27.772852 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-efcb2747-a054-4467-97bb-be606c8a5d60 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:27.916369 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-efcb2747-a054-4467-97bb-be606c8a5d60 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:27.924207 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-efcb2747-a054-4467-97bb-be606c8a5d60 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.165693 Jun 23 08:32:27.924809 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 577/1143] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:27 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:28.480512 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2999ccf7-1d28-492d-82b7-3d9318536611 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:28.481844 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2999ccf7-1d28-492d-82b7-3d9318536611 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:28.494399 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2999ccf7-1d28-492d-82b7-3d9318536611 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:28.497204 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2999ccf7-1d28-492d-82b7-3d9318536611 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:28.499716 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2999ccf7-1d28-492d-82b7-3d9318536611 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:28.503822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2999ccf7-1d28-492d-82b7-3d9318536611 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:28.634548 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2999ccf7-1d28-492d-82b7-3d9318536611 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:28.642383 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2999ccf7-1d28-492d-82b7-3d9318536611 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1189 microversion: 2.1 time: 0.165720 Jun 23 08:32:28.643397 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 567/1144] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:28 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1189 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:28.941676 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-db8134e6-21da-468d-a4e3-083d2c0485fd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:28.942257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-db8134e6-21da-468d-a4e3-083d2c0485fd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:28.949211 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db8134e6-21da-468d-a4e3-083d2c0485fd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:28.949638 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db8134e6-21da-468d-a4e3-083d2c0485fd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:28.950398 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db8134e6-21da-468d-a4e3-083d2c0485fd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:28.951201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db8134e6-21da-468d-a4e3-083d2c0485fd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:29.095599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-db8134e6-21da-468d-a4e3-083d2c0485fd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:29.103573 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-db8134e6-21da-468d-a4e3-083d2c0485fd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.165854 Jun 23 08:32:29.104145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 578/1145] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:28 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:29.659934 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4f799353-1ec8-46a7-b3e8-aad188d7b5ec tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:29.660537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4f799353-1ec8-46a7-b3e8-aad188d7b5ec tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:29.667772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4f799353-1ec8-46a7-b3e8-aad188d7b5ec tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:29.668289 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4f799353-1ec8-46a7-b3e8-aad188d7b5ec tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:29.669107 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4f799353-1ec8-46a7-b3e8-aad188d7b5ec tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:29.669534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4f799353-1ec8-46a7-b3e8-aad188d7b5ec tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:29.759907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4f799353-1ec8-46a7-b3e8-aad188d7b5ec tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:29.767714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4f799353-1ec8-46a7-b3e8-aad188d7b5ec tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1195 microversion: 2.1 time: 0.111852 Jun 23 08:32:29.768621 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 568/1146] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:29 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1195 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:30.120031 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bc082301-d9a5-4bfc-85fd-178992ad6822 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:30.121494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bc082301-d9a5-4bfc-85fd-178992ad6822 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:30.129396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc082301-d9a5-4bfc-85fd-178992ad6822 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:30.129857 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc082301-d9a5-4bfc-85fd-178992ad6822 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:30.130625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc082301-d9a5-4bfc-85fd-178992ad6822 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:30.131073 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bc082301-d9a5-4bfc-85fd-178992ad6822 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:30.291374 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-bc082301-d9a5-4bfc-85fd-178992ad6822 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:30.302310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bc082301-d9a5-4bfc-85fd-178992ad6822 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.186044 Jun 23 08:32:30.304269 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 579/1147] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:30 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:30.560862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-86d5d4de-66e6-48c2-aa0f-5c3bac4b8e38 req-e99d2ea2-e84e-4d4c-8ce1-a1fd209a9983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23522f32-f998-4da9-becd-a9025e7aa51f", "name": "network-vif-plugged", "status": "completed", "tag": "7cb06001-8150-4b24-a798-8cf3df9b607b"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:30.569294 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-86d5d4de-66e6-48c2-aa0f-5c3bac4b8e38 req-e99d2ea2-e84e-4d4c-8ce1-a1fd209a9983 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:30.569735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-86d5d4de-66e6-48c2-aa0f-5c3bac4b8e38 req-e99d2ea2-e84e-4d4c-8ce1-a1fd209a9983 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:30.580952 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-86d5d4de-66e6-48c2-aa0f-5c3bac4b8e38 req-e99d2ea2-e84e-4d4c-8ce1-a1fd209a9983 service nova] Creating event network-vif-plugged:7cb06001-8150-4b24-a798-8cf3df9b607b for instance 23522f32-f998-4da9-becd-a9025e7aa51f on hv-cinder-84721 Jun 23 08:32:30.586667 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-86d5d4de-66e6-48c2-aa0f-5c3bac4b8e38 req-e99d2ea2-e84e-4d4c-8ce1-a1fd209a9983 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107998 Jun 23 08:32:30.587288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 569/1148] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:32:30.787546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-101a43ba-e40c-4019-af40-fffa757cc02d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:30.788277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-101a43ba-e40c-4019-af40-fffa757cc02d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:30.800347 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-101a43ba-e40c-4019-af40-fffa757cc02d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:30.802414 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-101a43ba-e40c-4019-af40-fffa757cc02d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:30.803326 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-101a43ba-e40c-4019-af40-fffa757cc02d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:30.811094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-101a43ba-e40c-4019-af40-fffa757cc02d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:30.896094 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-cb5882dc-039e-4431-b0a2-85b4c935e0a8 req-e933185d-312b-47d6-bab1-b4acf0f64e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab012304-0cdc-48ca-ba38-b0d8859deced", "tag": "ed94646a-fad2-4a1b-b7a9-fa9296d27eff"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:30.907863 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-cb5882dc-039e-4431-b0a2-85b4c935e0a8 req-e933185d-312b-47d6-bab1-b4acf0f64e89 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:30.908783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-cb5882dc-039e-4431-b0a2-85b4c935e0a8 req-e933185d-312b-47d6-bab1-b4acf0f64e89 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:30.932798 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-cb5882dc-039e-4431-b0a2-85b4c935e0a8 req-e933185d-312b-47d6-bab1-b4acf0f64e89 service nova] Creating event network-changed:ed94646a-fad2-4a1b-b7a9-fa9296d27eff for instance ab012304-0cdc-48ca-ba38-b0d8859deced on hv-cinder-84721 Jun 23 08:32:30.938485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-cb5882dc-039e-4431-b0a2-85b4c935e0a8 req-e933185d-312b-47d6-bab1-b4acf0f64e89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047270 Jun 23 08:32:30.942307 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 570/1149] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:32:30.984248 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-101a43ba-e40c-4019-af40-fffa757cc02d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:30.992914 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-101a43ba-e40c-4019-af40-fffa757cc02d tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.209560 Jun 23 08:32:30.993730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 580/1150] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:30 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:31.322782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ec1c2b4c-46a7-40dd-9d90-1df64160519a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:31.323921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ec1c2b4c-46a7-40dd-9d90-1df64160519a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:31.330967 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec1c2b4c-46a7-40dd-9d90-1df64160519a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:31.331479 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec1c2b4c-46a7-40dd-9d90-1df64160519a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:31.332259 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec1c2b4c-46a7-40dd-9d90-1df64160519a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:31.332708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ec1c2b4c-46a7-40dd-9d90-1df64160519a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:31.494772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ec1c2b4c-46a7-40dd-9d90-1df64160519a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:31.502726 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ec1c2b4c-46a7-40dd-9d90-1df64160519a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.184874 Jun 23 08:32:31.503325 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 571/1151] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:31 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:32:32.014257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f0319994-273f-4636-89fd-e4b96741c126 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:32.015170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f0319994-273f-4636-89fd-e4b96741c126 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:32.026067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0319994-273f-4636-89fd-e4b96741c126 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:32.026800 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0319994-273f-4636-89fd-e4b96741c126 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:32.028091 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0319994-273f-4636-89fd-e4b96741c126 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:32.028813 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f0319994-273f-4636-89fd-e4b96741c126 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:32.171010 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f0319994-273f-4636-89fd-e4b96741c126 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:32.178948 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f0319994-273f-4636-89fd-e4b96741c126 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.171384 Jun 23 08:32:32.179559 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 581/1152] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:32 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:32.520200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9e1db450-42b0-4dda-9a8c-386bd05481fe tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:32.521392 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9e1db450-42b0-4dda-9a8c-386bd05481fe tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:32.532348 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9e1db450-42b0-4dda-9a8c-386bd05481fe tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:32.532780 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9e1db450-42b0-4dda-9a8c-386bd05481fe tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:32.533560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9e1db450-42b0-4dda-9a8c-386bd05481fe tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:32.533971 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9e1db450-42b0-4dda-9a8c-386bd05481fe tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:32.738873 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9e1db450-42b0-4dda-9a8c-386bd05481fe tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:32.747417 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9e1db450-42b0-4dda-9a8c-386bd05481fe tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1362 microversion: 2.1 time: 0.231184 Jun 23 08:32:32.748506 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 572/1153] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:32 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:33.196535 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7de32680-f406-4983-98cc-e7b92545b0d4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:33.197373 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7de32680-f406-4983-98cc-e7b92545b0d4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:33.204590 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7de32680-f406-4983-98cc-e7b92545b0d4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:33.205048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7de32680-f406-4983-98cc-e7b92545b0d4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:33.205835 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7de32680-f406-4983-98cc-e7b92545b0d4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:33.206266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7de32680-f406-4983-98cc-e7b92545b0d4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:33.348392 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7de32680-f406-4983-98cc-e7b92545b0d4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:33.356518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7de32680-f406-4983-98cc-e7b92545b0d4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.163815 Jun 23 08:32:33.357137 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 582/1154] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:33 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:33.764526 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a25b7e19-8666-47a7-8911-c149e8bd72ef tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:33.765227 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a25b7e19-8666-47a7-8911-c149e8bd72ef tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:33.771850 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a25b7e19-8666-47a7-8911-c149e8bd72ef tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:33.772341 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a25b7e19-8666-47a7-8911-c149e8bd72ef tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:33.773099 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a25b7e19-8666-47a7-8911-c149e8bd72ef tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:33.773519 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a25b7e19-8666-47a7-8911-c149e8bd72ef tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:33.909244 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a25b7e19-8666-47a7-8911-c149e8bd72ef tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:33.917005 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a25b7e19-8666-47a7-8911-c149e8bd72ef tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1548 microversion: 2.1 time: 0.156424 Jun 23 08:32:33.917525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 573/1155] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:33 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:33.933956 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bd7438ca-a719-4f91-aafb-836bb1b0041f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:33.934445 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bd7438ca-a719-4f91-aafb-836bb1b0041f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:33.940954 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd7438ca-a719-4f91-aafb-836bb1b0041f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:33.941399 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd7438ca-a719-4f91-aafb-836bb1b0041f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:33.942173 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd7438ca-a719-4f91-aafb-836bb1b0041f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:33.942627 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bd7438ca-a719-4f91-aafb-836bb1b0041f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:34.022503 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bd7438ca-a719-4f91-aafb-836bb1b0041f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092360 Jun 23 08:32:34.023109 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 583/1156] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 08:32:33 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:32:34.373977 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-200cc841-a320-45e8-9093-130310bd3c5f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:34.374587 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-200cc841-a320-45e8-9093-130310bd3c5f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:34.381067 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-200cc841-a320-45e8-9093-130310bd3c5f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:34.381502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-200cc841-a320-45e8-9093-130310bd3c5f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:34.382255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-200cc841-a320-45e8-9093-130310bd3c5f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:34.382886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-200cc841-a320-45e8-9093-130310bd3c5f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:34.611954 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-200cc841-a320-45e8-9093-130310bd3c5f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:34.620782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-200cc841-a320-45e8-9093-130310bd3c5f tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.250918 Jun 23 08:32:34.621458 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 574/1157] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:34 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:35.062353 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:35.063397 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=12 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:35.068158 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-32a4b026-a770-4fc9-b814-c858fc5e1a82 req-9eb87562-75b7-41e3-91d9-c69e616acb3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23522f32-f998-4da9-becd-a9025e7aa51f", "tag": "7cb06001-8150-4b24-a798-8cf3df9b607b"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:35.077582 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-32a4b026-a770-4fc9-b814-c858fc5e1a82 req-9eb87562-75b7-41e3-91d9-c69e616acb3e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:35.078275 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-32a4b026-a770-4fc9-b814-c858fc5e1a82 req-9eb87562-75b7-41e3-91d9-c69e616acb3e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:35.089599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-32a4b026-a770-4fc9-b814-c858fc5e1a82 req-9eb87562-75b7-41e3-91d9-c69e616acb3e service nova] Creating event network-changed:7cb06001-8150-4b24-a798-8cf3df9b607b for instance 23522f32-f998-4da9-becd-a9025e7aa51f on hv-cinder-84721 Jun 23 08:32:35.094891 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-32a4b026-a770-4fc9-b814-c858fc5e1a82 req-9eb87562-75b7-41e3-91d9-c69e616acb3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033832 Jun 23 08:32:35.095690 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 584/1158] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:32:35.638130 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9a0e0e94-918a-409a-94d1-bfdf3997765c tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:35.639459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9a0e0e94-918a-409a-94d1-bfdf3997765c tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:35.642338 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:35.651281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a0e0e94-918a-409a-94d1-bfdf3997765c tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:35.651999 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a0e0e94-918a-409a-94d1-bfdf3997765c tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:35.653073 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a0e0e94-918a-409a-94d1-bfdf3997765c tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:35.653662 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9a0e0e94-918a-409a-94d1-bfdf3997765c tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:36.057897 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9a0e0e94-918a-409a-94d1-bfdf3997765c tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:36.069698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9a0e0e94-918a-409a-94d1-bfdf3997765c tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.434951 Jun 23 08:32:36.071984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 575/1159] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:35 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:37.090040 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-27a6d6d3-2d04-49f4-8469-9d0892f005bd tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:37.090846 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-27a6d6d3-2d04-49f4-8469-9d0892f005bd tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:37.098246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-27a6d6d3-2d04-49f4-8469-9d0892f005bd tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:37.098819 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-27a6d6d3-2d04-49f4-8469-9d0892f005bd tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:37.100436 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-27a6d6d3-2d04-49f4-8469-9d0892f005bd tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:37.100947 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-27a6d6d3-2d04-49f4-8469-9d0892f005bd tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:37.244194 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-27a6d6d3-2d04-49f4-8469-9d0892f005bd tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:37.252256 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-27a6d6d3-2d04-49f4-8469-9d0892f005bd tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.166697 Jun 23 08:32:37.252923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 585/1160] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:37 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:38.269441 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1e69b4dd-8268-4f99-acc9-b4b8b8410c69 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:38.270736 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1e69b4dd-8268-4f99-acc9-b4b8b8410c69 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:38.285372 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e69b4dd-8268-4f99-acc9-b4b8b8410c69 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:38.285853 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e69b4dd-8268-4f99-acc9-b4b8b8410c69 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:38.286624 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e69b4dd-8268-4f99-acc9-b4b8b8410c69 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:38.287051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1e69b4dd-8268-4f99-acc9-b4b8b8410c69 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:38.430976 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1e69b4dd-8268-4f99-acc9-b4b8b8410c69 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:38.439651 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1e69b4dd-8268-4f99-acc9-b4b8b8410c69 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.173809 Jun 23 08:32:38.440318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 576/1161] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:38 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:39.457418 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e54119f4-5d4d-4c04-a8d5-ecdb255a1ded tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:39.458085 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e54119f4-5d4d-4c04-a8d5-ecdb255a1ded tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:39.465086 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e54119f4-5d4d-4c04-a8d5-ecdb255a1ded tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:39.465645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e54119f4-5d4d-4c04-a8d5-ecdb255a1ded tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:39.466278 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e54119f4-5d4d-4c04-a8d5-ecdb255a1ded tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:39.466705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e54119f4-5d4d-4c04-a8d5-ecdb255a1ded tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:39.609924 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e54119f4-5d4d-4c04-a8d5-ecdb255a1ded tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:39.617933 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e54119f4-5d4d-4c04-a8d5-ecdb255a1ded tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.164771 Jun 23 08:32:39.618494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 586/1162] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:39 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:40.634741 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-efff7413-58b4-4309-abe0-b432e5fe91e3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:40.635444 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-efff7413-58b4-4309-abe0-b432e5fe91e3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:40.644910 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-efff7413-58b4-4309-abe0-b432e5fe91e3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:40.645459 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-efff7413-58b4-4309-abe0-b432e5fe91e3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:40.646217 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-efff7413-58b4-4309-abe0-b432e5fe91e3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:40.646649 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-efff7413-58b4-4309-abe0-b432e5fe91e3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:40.796219 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-efff7413-58b4-4309-abe0-b432e5fe91e3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:40.807898 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-efff7413-58b4-4309-abe0-b432e5fe91e3 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.176738 Jun 23 08:32:40.808715 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 577/1163] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:40 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:41.827895 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-457e5d50-e837-4e0e-8e3f-3105bc099e64 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:41.828503 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-457e5d50-e837-4e0e-8e3f-3105bc099e64 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:41.835787 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-457e5d50-e837-4e0e-8e3f-3105bc099e64 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:41.836248 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-457e5d50-e837-4e0e-8e3f-3105bc099e64 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:41.837035 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-457e5d50-e837-4e0e-8e3f-3105bc099e64 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:41.837466 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-457e5d50-e837-4e0e-8e3f-3105bc099e64 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:41.981916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-457e5d50-e837-4e0e-8e3f-3105bc099e64 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:41.989731 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-457e5d50-e837-4e0e-8e3f-3105bc099e64 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.165894 Jun 23 08:32:41.990334 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 587/1164] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:41 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:43.009367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e2cd0302-698a-4dbe-873d-2c864e7ec9c4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:43.009958 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e2cd0302-698a-4dbe-873d-2c864e7ec9c4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:43.017686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e2cd0302-698a-4dbe-873d-2c864e7ec9c4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:43.018104 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e2cd0302-698a-4dbe-873d-2c864e7ec9c4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:43.018864 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e2cd0302-698a-4dbe-873d-2c864e7ec9c4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:43.019347 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e2cd0302-698a-4dbe-873d-2c864e7ec9c4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:43.025299 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=100 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:43.164215 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e2cd0302-698a-4dbe-873d-2c864e7ec9c4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:43.172012 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e2cd0302-698a-4dbe-873d-2c864e7ec9c4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.166910 Jun 23 08:32:43.172590 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 578/1165] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:43 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:44.189504 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-66a34094-aa08-4876-a54d-55c6756996f0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:44.190131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-66a34094-aa08-4876-a54d-55c6756996f0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:44.197283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-66a34094-aa08-4876-a54d-55c6756996f0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:44.197723 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-66a34094-aa08-4876-a54d-55c6756996f0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:44.198488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-66a34094-aa08-4876-a54d-55c6756996f0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:44.198935 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-66a34094-aa08-4876-a54d-55c6756996f0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:44.203079 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=100 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:44.333713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-66a34094-aa08-4876-a54d-55c6756996f0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:44.341871 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-66a34094-aa08-4876-a54d-55c6756996f0 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.156602 Jun 23 08:32:44.342471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 588/1166] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:44 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:44.528786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-fab09efd-2792-4b36-b1ef-48852b801c8c req-4113e468-ba47-4fbe-bf4d-8d78b2bd63f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab012304-0cdc-48ca-ba38-b0d8859deced", "name": "network-vif-plugged", "status": "completed", "tag": "ed94646a-fad2-4a1b-b7a9-fa9296d27eff"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:44.536813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:32:44.544269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-fab09efd-2792-4b36-b1ef-48852b801c8c req-4113e468-ba47-4fbe-bf4d-8d78b2bd63f2 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:44.544705 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-fab09efd-2792-4b36-b1ef-48852b801c8c req-4113e468-ba47-4fbe-bf4d-8d78b2bd63f2 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:44.557350 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-fab09efd-2792-4b36-b1ef-48852b801c8c req-4113e468-ba47-4fbe-bf4d-8d78b2bd63f2 service nova] Creating event network-vif-plugged:ed94646a-fad2-4a1b-b7a9-fa9296d27eff for instance ab012304-0cdc-48ca-ba38-b0d8859deced on hv-cinder-84721 Jun 23 08:32:44.562698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-fab09efd-2792-4b36-b1ef-48852b801c8c req-4113e468-ba47-4fbe-bf4d-8d78b2bd63f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038435 Jun 23 08:32:44.563496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 579/1167] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:32:45.360220 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f4267948-88ac-4488-b8b5-3deba474ffd4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:45.360934 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f4267948-88ac-4488-b8b5-3deba474ffd4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:45.369182 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4267948-88ac-4488-b8b5-3deba474ffd4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:45.369631 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4267948-88ac-4488-b8b5-3deba474ffd4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:45.370406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4267948-88ac-4488-b8b5-3deba474ffd4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:45.370855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f4267948-88ac-4488-b8b5-3deba474ffd4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:45.515600 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f4267948-88ac-4488-b8b5-3deba474ffd4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:45.526367 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f4267948-88ac-4488-b8b5-3deba474ffd4 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1263 microversion: 2.1 time: 0.170183 Jun 23 08:32:45.526967 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 589/1168] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:45 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:46.548338 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4b03b5f4-1abb-4ea1-ba25-aafadf28c2ab tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:46.549171 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4b03b5f4-1abb-4ea1-ba25-aafadf28c2ab tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:46.555980 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b03b5f4-1abb-4ea1-ba25-aafadf28c2ab tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:46.556441 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b03b5f4-1abb-4ea1-ba25-aafadf28c2ab tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:46.557266 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b03b5f4-1abb-4ea1-ba25-aafadf28c2ab tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:46.557763 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4b03b5f4-1abb-4ea1-ba25-aafadf28c2ab tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:46.696051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4b03b5f4-1abb-4ea1-ba25-aafadf28c2ab tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:46.704003 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4b03b5f4-1abb-4ea1-ba25-aafadf28c2ab tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1450 microversion: 2.1 time: 0.161669 Jun 23 08:32:46.704577 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 580/1169] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:46 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:46.725927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a6e80109-829c-4bf4-843f-ca43b958d63a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:32:46.726529 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a6e80109-829c-4bf4-843f-ca43b958d63a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:32:46.734582 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a6e80109-829c-4bf4-843f-ca43b958d63a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:46.735018 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a6e80109-829c-4bf4-843f-ca43b958d63a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:46.735828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a6e80109-829c-4bf4-843f-ca43b958d63a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:46.736268 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a6e80109-829c-4bf4-843f-ca43b958d63a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:46.884154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a6e80109-829c-4bf4-843f-ca43b958d63a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:32:46.892457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a6e80109-829c-4bf4-843f-ca43b958d63a tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1450 microversion: 2.1 time: 0.170476 Jun 23 08:32:46.893030 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 590/1170] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:32:46 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:32:48.866817 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-4695e1ea-c608-42f9-8a44-fe93b96fdd3b req-2c6ce0c7-cb1b-4534-bcaf-90b134d57b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab012304-0cdc-48ca-ba38-b0d8859deced", "tag": "ed94646a-fad2-4a1b-b7a9-fa9296d27eff"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:32:48.875831 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-4695e1ea-c608-42f9-8a44-fe93b96fdd3b req-2c6ce0c7-cb1b-4534-bcaf-90b134d57b2c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:32:48.876269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-4695e1ea-c608-42f9-8a44-fe93b96fdd3b req-2c6ce0c7-cb1b-4534-bcaf-90b134d57b2c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:32:48.888064 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-4695e1ea-c608-42f9-8a44-fe93b96fdd3b req-2c6ce0c7-cb1b-4534-bcaf-90b134d57b2c service nova] Creating event network-changed:ed94646a-fad2-4a1b-b7a9-fa9296d27eff for instance ab012304-0cdc-48ca-ba38-b0d8859deced on hv-cinder-84721 Jun 23 08:32:48.893419 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-4695e1ea-c608-42f9-8a44-fe93b96fdd3b req-2c6ce0c7-cb1b-4534-bcaf-90b134d57b2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164441 Jun 23 08:32:48.894157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 581/1171] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:33:15.031711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:15.033213 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=16 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:15.208088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-17f312fc-4a32-4c99-b8bb-2e615dff4bff tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Action: 'create', calling method: .version_select at 0x7feb682a6dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1380896725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9n8XxIqp5Au9iHAeHBMqLn3npLMxOPb7Pd3us1ps1s7zbVVgctErKyRV2UFJhZIaZww2urrusOEGPsQer06U7t7RJa3bK02AyG7VxV24MgKb6rCSTiJ7vW8GcWjHG7KA=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:33:15.223588 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-17f312fc-4a32-4c99-b8bb-2e615dff4bff tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Getting quotas for project 86a447448dde4ecd80717993f58f33a7. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:33:15.227468 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-17f312fc-4a32-4c99-b8bb-2e615dff4bff tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Getting quotas for user 1eb79dd547c04d2eac6dc1e35311bd9c and project 86a447448dde4ecd80717993f58f33a7. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:33:15.253328 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-17f312fc-4a32-4c99-b8bb-2e615dff4bff tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.226562 Jun 23 08:33:15.253980 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 591/1172] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:33:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:33:37.908607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=5 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:37.909371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=14 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:37.914719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-983064650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1380896725", "security_groups": [{"name": "tempest-secgroup-smoke-557004161"}], "networks": [{"uuid": "6a3c53df-9241-40c2-8286-07cafe82ff6d"}], "block_device_mapping_v2": [{"uuid": "beadcb68-3ac5-47dd-af98-67a4044f81f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:33:38.052599 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] validate_networks() for [('6a3c53df-9241-40c2-8286-07cafe82ff6d', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:33:38.424769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:33:38.425346 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:33:38.426039 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:33:38.426611 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:33:38.427225 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:33:38.439002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:38.439477 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:38.440266 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:38.440726 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:38.458151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Getting quotas for project 86a447448dde4ecd80717993f58f33a7. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:33:38.462755 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Getting quotas for user 1eb79dd547c04d2eac6dc1e35311bd9c and project 86a447448dde4ecd80717993f58f33a7. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:33:38.521258 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:33:38.523489 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='beadcb68-3ac5-47dd-af98-67a4044f81f8',volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:33:38.665034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d8e1e155-8fe2-42f9-b9e3-21e3e1559f74 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758482 Jun 23 08:33:38.665724 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 582/1173] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:33:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:33:38.673782 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=4 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:38.674562 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:38.678812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-89ba1fb0-fe7a-447e-98b0-9dda7068aa84 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:38.679458 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-89ba1fb0-fe7a-447e-98b0-9dda7068aa84 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:38.735635 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-89ba1fb0-fe7a-447e-98b0-9dda7068aa84 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:38.742525 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-89ba1fb0-fe7a-447e-98b0-9dda7068aa84 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1088 microversion: 2.1 time: 0.070026 Jun 23 08:33:38.743098 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 592/1174] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:38 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:39.760122 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-55f55cd6-9177-4222-9eee-85034d25f685 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:39.760788 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-55f55cd6-9177-4222-9eee-85034d25f685 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:39.770301 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-55f55cd6-9177-4222-9eee-85034d25f685 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:39.770876 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-55f55cd6-9177-4222-9eee-85034d25f685 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:39.771682 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-55f55cd6-9177-4222-9eee-85034d25f685 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:39.772108 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-55f55cd6-9177-4222-9eee-85034d25f685 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:39.849105 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-55f55cd6-9177-4222-9eee-85034d25f685 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:39.857586 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-55f55cd6-9177-4222-9eee-85034d25f685 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1204 microversion: 2.1 time: 0.101412 Jun 23 08:33:39.858337 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 583/1175] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:39 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:40.877180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c8b6a754-3ed0-49f4-8512-1f3bc5c04574 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:40.877819 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c8b6a754-3ed0-49f4-8512-1f3bc5c04574 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:40.885672 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8b6a754-3ed0-49f4-8512-1f3bc5c04574 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:40.886136 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8b6a754-3ed0-49f4-8512-1f3bc5c04574 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:40.887476 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8b6a754-3ed0-49f4-8512-1f3bc5c04574 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:40.887994 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c8b6a754-3ed0-49f4-8512-1f3bc5c04574 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:41.043608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c8b6a754-3ed0-49f4-8512-1f3bc5c04574 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:41.052302 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c8b6a754-3ed0-49f4-8512-1f3bc5c04574 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.179349 Jun 23 08:33:41.053307 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 593/1176] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:40 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:33:41.151767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-4d220f0b-e18a-457a-b52d-6faaf405c02e req-2f2bcbad-d406-435e-a86c-dd45e1c17ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5eca28d-5c90-4969-8a73-702bc7738287", "tag": "7097fd07-3267-400c-858a-3201571bf146"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:33:41.162241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-4d220f0b-e18a-457a-b52d-6faaf405c02e req-2f2bcbad-d406-435e-a86c-dd45e1c17ea9 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:41.163439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-4d220f0b-e18a-457a-b52d-6faaf405c02e req-2f2bcbad-d406-435e-a86c-dd45e1c17ea9 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:41.179571 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-4d220f0b-e18a-457a-b52d-6faaf405c02e req-2f2bcbad-d406-435e-a86c-dd45e1c17ea9 service nova] Creating event network-changed:7097fd07-3267-400c-858a-3201571bf146 for instance f5eca28d-5c90-4969-8a73-702bc7738287 on hv-cinder-84721 Jun 23 08:33:41.186673 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-4d220f0b-e18a-457a-b52d-6faaf405c02e req-2f2bcbad-d406-435e-a86c-dd45e1c17ea9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041062 Jun 23 08:33:41.187665 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 584/1177] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:33:42.074603 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d8500d9c-d334-455a-8b88-7b6b590a28c7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:42.075293 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d8500d9c-d334-455a-8b88-7b6b590a28c7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:42.083115 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8500d9c-d334-455a-8b88-7b6b590a28c7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:42.083639 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8500d9c-d334-455a-8b88-7b6b590a28c7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:42.084511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8500d9c-d334-455a-8b88-7b6b590a28c7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:42.084979 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d8500d9c-d334-455a-8b88-7b6b590a28c7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:42.222275 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d8500d9c-d334-455a-8b88-7b6b590a28c7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:42.230437 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d8500d9c-d334-455a-8b88-7b6b590a28c7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.162600 Jun 23 08:33:42.231016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 594/1178] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:42 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:43.248389 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-35d2e400-c64c-424e-8f77-8460c8a46339 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:43.249049 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-35d2e400-c64c-424e-8f77-8460c8a46339 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:43.256545 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-35d2e400-c64c-424e-8f77-8460c8a46339 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:43.256988 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-35d2e400-c64c-424e-8f77-8460c8a46339 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:43.257769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-35d2e400-c64c-424e-8f77-8460c8a46339 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:43.258197 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-35d2e400-c64c-424e-8f77-8460c8a46339 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:43.458648 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-35d2e400-c64c-424e-8f77-8460c8a46339 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:43.466561 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-35d2e400-c64c-424e-8f77-8460c8a46339 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.222534 Jun 23 08:33:43.467101 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 585/1179] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:43 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:44.488118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d3685248-20ea-4429-8718-f3069101ac75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:44.489088 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d3685248-20ea-4429-8718-f3069101ac75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:44.498733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d3685248-20ea-4429-8718-f3069101ac75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:44.499187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d3685248-20ea-4429-8718-f3069101ac75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:44.499994 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d3685248-20ea-4429-8718-f3069101ac75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:44.500430 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d3685248-20ea-4429-8718-f3069101ac75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:44.642939 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d3685248-20ea-4429-8718-f3069101ac75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:44.650645 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d3685248-20ea-4429-8718-f3069101ac75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.169328 Jun 23 08:33:44.651230 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 595/1180] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:44 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:45.676645 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-afab5b75-668b-420c-bb53-fc509728c721 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:45.677641 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-afab5b75-668b-420c-bb53-fc509728c721 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:45.688919 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-afab5b75-668b-420c-bb53-fc509728c721 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:45.689677 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-afab5b75-668b-420c-bb53-fc509728c721 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:45.690913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-afab5b75-668b-420c-bb53-fc509728c721 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:45.691670 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-afab5b75-668b-420c-bb53-fc509728c721 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:45.844553 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-afab5b75-668b-420c-bb53-fc509728c721 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:45.855735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-afab5b75-668b-420c-bb53-fc509728c721 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.185688 Jun 23 08:33:45.856547 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 586/1181] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:45 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:46.881961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-94605da9-059f-41ae-8ddd-5cf5ad2b9632 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:46.883011 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-94605da9-059f-41ae-8ddd-5cf5ad2b9632 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:46.894015 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94605da9-059f-41ae-8ddd-5cf5ad2b9632 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:46.894748 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94605da9-059f-41ae-8ddd-5cf5ad2b9632 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:46.896101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94605da9-059f-41ae-8ddd-5cf5ad2b9632 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:46.896812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94605da9-059f-41ae-8ddd-5cf5ad2b9632 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:47.033661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-94605da9-059f-41ae-8ddd-5cf5ad2b9632 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:47.041456 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-94605da9-059f-41ae-8ddd-5cf5ad2b9632 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.166036 Jun 23 08:33:47.042028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 596/1182] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:46 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:48.061482 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-394ddc7b-6aba-4401-9da7-ac68e166445e tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:48.062081 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-394ddc7b-6aba-4401-9da7-ac68e166445e tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:48.069066 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-394ddc7b-6aba-4401-9da7-ac68e166445e tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:48.069517 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-394ddc7b-6aba-4401-9da7-ac68e166445e tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:48.070278 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-394ddc7b-6aba-4401-9da7-ac68e166445e tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:48.070712 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-394ddc7b-6aba-4401-9da7-ac68e166445e tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:48.213020 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-394ddc7b-6aba-4401-9da7-ac68e166445e tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:48.221367 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-394ddc7b-6aba-4401-9da7-ac68e166445e tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.165940 Jun 23 08:33:48.221931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 587/1183] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:48 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:49.238428 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e94586fc-10e0-4c0e-8df6-bd2371e61696 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:49.238982 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e94586fc-10e0-4c0e-8df6-bd2371e61696 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:49.241453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=2 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:49.248093 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e94586fc-10e0-4c0e-8df6-bd2371e61696 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:49.248528 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e94586fc-10e0-4c0e-8df6-bd2371e61696 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:49.249283 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e94586fc-10e0-4c0e-8df6-bd2371e61696 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:49.249711 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e94586fc-10e0-4c0e-8df6-bd2371e61696 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:49.393716 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-e94586fc-10e0-4c0e-8df6-bd2371e61696 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:49.401386 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e94586fc-10e0-4c0e-8df6-bd2371e61696 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.166978 Jun 23 08:33:49.402076 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 597/1184] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:49 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:50.418473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-09c02936-1949-42d1-bdae-9ecc5bf62e7a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:50.419100 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-09c02936-1949-42d1-bdae-9ecc5bf62e7a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:50.421446 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:50.422144 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:33:50.428778 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-09c02936-1949-42d1-bdae-9ecc5bf62e7a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:50.429245 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-09c02936-1949-42d1-bdae-9ecc5bf62e7a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:50.430024 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-09c02936-1949-42d1-bdae-9ecc5bf62e7a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:50.430467 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-09c02936-1949-42d1-bdae-9ecc5bf62e7a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:50.569191 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-09c02936-1949-42d1-bdae-9ecc5bf62e7a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:50.578896 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-09c02936-1949-42d1-bdae-9ecc5bf62e7a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.164496 Jun 23 08:33:50.579501 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 588/1185] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:50 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:51.597751 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a2f795ac-ba2d-4bfa-96c6-239caa698b8d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:51.598350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a2f795ac-ba2d-4bfa-96c6-239caa698b8d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:51.606641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a2f795ac-ba2d-4bfa-96c6-239caa698b8d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:51.607239 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a2f795ac-ba2d-4bfa-96c6-239caa698b8d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:51.608018 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a2f795ac-ba2d-4bfa-96c6-239caa698b8d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:51.608447 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a2f795ac-ba2d-4bfa-96c6-239caa698b8d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:51.749822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-a2f795ac-ba2d-4bfa-96c6-239caa698b8d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:51.757818 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a2f795ac-ba2d-4bfa-96c6-239caa698b8d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.165365 Jun 23 08:33:51.758363 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 598/1186] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:51 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:52.776008 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dfbc6502-10fe-4c31-bc4e-dcdff57e1596 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:52.776581 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dfbc6502-10fe-4c31-bc4e-dcdff57e1596 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:52.783404 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dfbc6502-10fe-4c31-bc4e-dcdff57e1596 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:52.783847 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dfbc6502-10fe-4c31-bc4e-dcdff57e1596 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:52.784730 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dfbc6502-10fe-4c31-bc4e-dcdff57e1596 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:52.785162 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dfbc6502-10fe-4c31-bc4e-dcdff57e1596 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:52.798718 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-8d4f531e-13b1-453a-95d1-06ce6d5e8ac4 req-51f5a213-c1e6-45bd-8a2c-86754469b8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5eca28d-5c90-4969-8a73-702bc7738287", "name": "network-vif-plugged", "status": "completed", "tag": "7097fd07-3267-400c-858a-3201571bf146"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:33:52.808743 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-8d4f531e-13b1-453a-95d1-06ce6d5e8ac4 req-51f5a213-c1e6-45bd-8a2c-86754469b8e7 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:52.809265 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-8d4f531e-13b1-453a-95d1-06ce6d5e8ac4 req-51f5a213-c1e6-45bd-8a2c-86754469b8e7 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:52.821453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-8d4f531e-13b1-453a-95d1-06ce6d5e8ac4 req-51f5a213-c1e6-45bd-8a2c-86754469b8e7 service nova] Creating event network-vif-plugged:7097fd07-3267-400c-858a-3201571bf146 for instance f5eca28d-5c90-4969-8a73-702bc7738287 on hv-cinder-84721 Jun 23 08:33:52.826905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-8d4f531e-13b1-453a-95d1-06ce6d5e8ac4 req-51f5a213-c1e6-45bd-8a2c-86754469b8e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031991 Jun 23 08:33:52.827661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 599/1187] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:33:52.923701 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-dfbc6502-10fe-4c31-bc4e-dcdff57e1596 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:52.931708 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dfbc6502-10fe-4c31-bc4e-dcdff57e1596 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.160225 Jun 23 08:33:52.932247 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 589/1188] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:52 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:53.953310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c746bb87-e551-435e-b2d2-22a9485dafc7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:53.956214 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c746bb87-e551-435e-b2d2-22a9485dafc7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:53.960978 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c746bb87-e551-435e-b2d2-22a9485dafc7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:53.961417 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c746bb87-e551-435e-b2d2-22a9485dafc7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:53.962185 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c746bb87-e551-435e-b2d2-22a9485dafc7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:53.962592 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c746bb87-e551-435e-b2d2-22a9485dafc7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:54.101793 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c746bb87-e551-435e-b2d2-22a9485dafc7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:54.109969 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c746bb87-e551-435e-b2d2-22a9485dafc7 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1259 microversion: 2.1 time: 0.163842 Jun 23 08:33:54.110534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 600/1189] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:53 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:55.127327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9d2dddf8-4810-4eac-afab-0c8671ecf135 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:55.127987 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9d2dddf8-4810-4eac-afab-0c8671ecf135 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:55.134479 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9d2dddf8-4810-4eac-afab-0c8671ecf135 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:55.134921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9d2dddf8-4810-4eac-afab-0c8671ecf135 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:55.135699 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9d2dddf8-4810-4eac-afab-0c8671ecf135 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:55.136122 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9d2dddf8-4810-4eac-afab-0c8671ecf135 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:55.279340 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-9d2dddf8-4810-4eac-afab-0c8671ecf135 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:55.287566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9d2dddf8-4810-4eac-afab-0c8671ecf135 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1443 microversion: 2.1 time: 0.164556 Jun 23 08:33:55.288141 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 590/1190] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:55 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:55.304101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7eb376e4-e43f-4aea-9fdf-db569ae84471 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:33:55.304699 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7eb376e4-e43f-4aea-9fdf-db569ae84471 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:33:55.311616 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7eb376e4-e43f-4aea-9fdf-db569ae84471 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:55.312093 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7eb376e4-e43f-4aea-9fdf-db569ae84471 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:55.312861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7eb376e4-e43f-4aea-9fdf-db569ae84471 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:55.313293 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7eb376e4-e43f-4aea-9fdf-db569ae84471 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:55.453418 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7eb376e4-e43f-4aea-9fdf-db569ae84471 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:33:55.461424 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7eb376e4-e43f-4aea-9fdf-db569ae84471 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1443 microversion: 2.1 time: 0.161221 Jun 23 08:33:55.462002 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 601/1191] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:33:55 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:33:57.488965 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-d2316fcb-4d04-462c-ae35-b224ec54083c req-ba55c375-23d4-494f-9d1f-7e982fd2abb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5eca28d-5c90-4969-8a73-702bc7738287", "tag": "7097fd07-3267-400c-858a-3201571bf146"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:33:57.498092 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-d2316fcb-4d04-462c-ae35-b224ec54083c req-ba55c375-23d4-494f-9d1f-7e982fd2abb8 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:33:57.498524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-d2316fcb-4d04-462c-ae35-b224ec54083c req-ba55c375-23d4-494f-9d1f-7e982fd2abb8 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:33:57.511260 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-d2316fcb-4d04-462c-ae35-b224ec54083c req-ba55c375-23d4-494f-9d1f-7e982fd2abb8 service nova] Creating event network-changed:7097fd07-3267-400c-858a-3201571bf146 for instance f5eca28d-5c90-4969-8a73-702bc7738287 on hv-cinder-84721 Jun 23 08:33:57.516889 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-d2316fcb-4d04-462c-ae35-b224ec54083c req-ba55c375-23d4-494f-9d1f-7e982fd2abb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032463 Jun 23 08:33:57.517483 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 591/1192] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:34:04.772494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-bdf1e675-e914-4ee5-89f8-e1afdd41fc79 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:04.773117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-bdf1e675-e914-4ee5-89f8-e1afdd41fc79 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:04.783654 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bdf1e675-e914-4ee5-89f8-e1afdd41fc79 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:04.784110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bdf1e675-e914-4ee5-89f8-e1afdd41fc79 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:04.784876 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bdf1e675-e914-4ee5-89f8-e1afdd41fc79 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:04.785300 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-bdf1e675-e914-4ee5-89f8-e1afdd41fc79 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:04.821878 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-bdf1e675-e914-4ee5-89f8-e1afdd41fc79 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/ips" status: 200 len: 146 microversion: 2.1 time: 0.055676 Jun 23 08:34:04.822481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 602/1193] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:34:04 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/ips => generated 146 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:34:07.111613 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-55357513-ecc1-48a0-8894-d151cf991fc3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12cfa4af-7805-48f1-b6f2-109aa720028f"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:34:07.112766 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-55357513-ecc1-48a0-8894-d151cf991fc3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:07.119580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-55357513-ecc1-48a0-8894-d151cf991fc3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:07.120022 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-55357513-ecc1-48a0-8894-d151cf991fc3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:07.120780 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-55357513-ecc1-48a0-8894-d151cf991fc3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:07.121208 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-55357513-ecc1-48a0-8894-d151cf991fc3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:07.394858 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-55357513-ecc1-48a0-8894-d151cf991fc3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288346 Jun 23 08:34:07.395516 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 592/1194] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:34:07 2022] POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:34:14.952233 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-22bfa36b-6843-4f2f-9312-3339387473df tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:34:14.954599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=24 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:34:14.955240 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=54 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:34:14.961658 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-22bfa36b-6843-4f2f-9312-3339387473df tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:14.962110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-22bfa36b-6843-4f2f-9312-3339387473df tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:15.024091 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-22bfa36b-6843-4f2f-9312-3339387473df tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Going to try to stop instance {{(pid=117758) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 08:34:15.074523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-22bfa36b-6843-4f2f-9312-3339387473df tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/action" status: 202 len: 0 microversion: 2.1 time: 0.126024 Jun 23 08:34:15.075187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 603/1195] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:34:14 2022] POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:34:15.083908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c595abeb-eb44-4afe-8cd8-b0cd821e2adf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:15.084591 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c595abeb-eb44-4afe-8cd8-b0cd821e2adf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:15.090056 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:34:15.092331 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c595abeb-eb44-4afe-8cd8-b0cd821e2adf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:15.092792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c595abeb-eb44-4afe-8cd8-b0cd821e2adf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:15.093566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c595abeb-eb44-4afe-8cd8-b0cd821e2adf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:15.093957 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c595abeb-eb44-4afe-8cd8-b0cd821e2adf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:15.097206 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:34:15.234117 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c595abeb-eb44-4afe-8cd8-b0cd821e2adf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:15.242279 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c595abeb-eb44-4afe-8cd8-b0cd821e2adf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.162587 Jun 23 08:34:15.243166 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 593/1196] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:15 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:16.261112 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-52e69be0-6b50-4e18-8b8f-4392a87c5268 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:16.261847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-52e69be0-6b50-4e18-8b8f-4392a87c5268 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:16.268631 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-52e69be0-6b50-4e18-8b8f-4392a87c5268 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:16.269047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-52e69be0-6b50-4e18-8b8f-4392a87c5268 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:16.269798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-52e69be0-6b50-4e18-8b8f-4392a87c5268 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:16.270226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-52e69be0-6b50-4e18-8b8f-4392a87c5268 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:16.412604 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-52e69be0-6b50-4e18-8b8f-4392a87c5268 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:16.421892 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-52e69be0-6b50-4e18-8b8f-4392a87c5268 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.165580 Jun 23 08:34:16.422462 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 604/1197] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:16 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:17.441139 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6eeea5d3-4078-412d-af63-1071fd1b3193 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:17.441785 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6eeea5d3-4078-412d-af63-1071fd1b3193 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:17.449809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6eeea5d3-4078-412d-af63-1071fd1b3193 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:17.450250 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6eeea5d3-4078-412d-af63-1071fd1b3193 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:17.451010 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6eeea5d3-4078-412d-af63-1071fd1b3193 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:17.451472 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6eeea5d3-4078-412d-af63-1071fd1b3193 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:17.597157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6eeea5d3-4078-412d-af63-1071fd1b3193 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:17.606426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6eeea5d3-4078-412d-af63-1071fd1b3193 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.169817 Jun 23 08:34:17.607112 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 594/1198] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:17 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:18.628963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c2f5239e-724d-425e-b969-c862eeeb142c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:18.629897 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c2f5239e-724d-425e-b969-c862eeeb142c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:18.638152 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c2f5239e-724d-425e-b969-c862eeeb142c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:18.638595 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c2f5239e-724d-425e-b969-c862eeeb142c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:18.639502 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c2f5239e-724d-425e-b969-c862eeeb142c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:18.639932 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c2f5239e-724d-425e-b969-c862eeeb142c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:18.782289 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c2f5239e-724d-425e-b969-c862eeeb142c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:18.791093 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c2f5239e-724d-425e-b969-c862eeeb142c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.168722 Jun 23 08:34:18.791710 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 605/1199] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:18 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:19.811031 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ff233a2a-c128-4953-bbe9-020ba4a10645 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:19.811765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ff233a2a-c128-4953-bbe9-020ba4a10645 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:19.820502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ff233a2a-c128-4953-bbe9-020ba4a10645 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:19.820796 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ff233a2a-c128-4953-bbe9-020ba4a10645 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:19.821742 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ff233a2a-c128-4953-bbe9-020ba4a10645 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:19.822283 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ff233a2a-c128-4953-bbe9-020ba4a10645 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:19.966394 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ff233a2a-c128-4953-bbe9-020ba4a10645 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:19.974976 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ff233a2a-c128-4953-bbe9-020ba4a10645 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.169000 Jun 23 08:34:19.975592 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 595/1200] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:19 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:34:21.002089 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-9b757b17-e28b-4d41-90b2-d7ad3998d9e0 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:21.003039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-9b757b17-e28b-4d41-90b2-d7ad3998d9e0 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:21.011797 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9b757b17-e28b-4d41-90b2-d7ad3998d9e0 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:21.012242 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9b757b17-e28b-4d41-90b2-d7ad3998d9e0 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:21.013034 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9b757b17-e28b-4d41-90b2-d7ad3998d9e0 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:21.013461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-9b757b17-e28b-4d41-90b2-d7ad3998d9e0 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:21.155589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-9b757b17-e28b-4d41-90b2-d7ad3998d9e0 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:21.164578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-9b757b17-e28b-4d41-90b2-d7ad3998d9e0 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.168800 Jun 23 08:34:21.165164 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 606/1201] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:20 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:22.184113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ece8e56f-61f5-4965-aeed-289dee1ed0ae tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:22.184757 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ece8e56f-61f5-4965-aeed-289dee1ed0ae tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:22.191566 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ece8e56f-61f5-4965-aeed-289dee1ed0ae tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:22.192006 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ece8e56f-61f5-4965-aeed-289dee1ed0ae tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:22.192756 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ece8e56f-61f5-4965-aeed-289dee1ed0ae tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:22.193179 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ece8e56f-61f5-4965-aeed-289dee1ed0ae tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:22.336921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ece8e56f-61f5-4965-aeed-289dee1ed0ae tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:22.345360 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ece8e56f-61f5-4965-aeed-289dee1ed0ae tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.165803 Jun 23 08:34:22.345910 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 596/1202] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:22 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:23.366035 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-cc1075db-a041-4ee0-85e6-50c151bcf99c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:23.367005 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-cc1075db-a041-4ee0-85e6-50c151bcf99c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:23.378371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cc1075db-a041-4ee0-85e6-50c151bcf99c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:23.379100 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cc1075db-a041-4ee0-85e6-50c151bcf99c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:23.380419 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cc1075db-a041-4ee0-85e6-50c151bcf99c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:23.381253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-cc1075db-a041-4ee0-85e6-50c151bcf99c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:23.524497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-cc1075db-a041-4ee0-85e6-50c151bcf99c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:23.532916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-cc1075db-a041-4ee0-85e6-50c151bcf99c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.173351 Jun 23 08:34:23.533521 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 607/1203] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:23 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:24.550962 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-511880a7-6dd0-44c4-9c96-449d4d7e214f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:24.551589 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-511880a7-6dd0-44c4-9c96-449d4d7e214f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:24.558765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-511880a7-6dd0-44c4-9c96-449d4d7e214f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:24.559230 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-511880a7-6dd0-44c4-9c96-449d4d7e214f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:24.559988 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-511880a7-6dd0-44c4-9c96-449d4d7e214f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:24.560510 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-511880a7-6dd0-44c4-9c96-449d4d7e214f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:24.691700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-511880a7-6dd0-44c4-9c96-449d4d7e214f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:24.700489 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-511880a7-6dd0-44c4-9c96-449d4d7e214f tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.153574 Jun 23 08:34:24.701062 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 597/1204] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:24 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:25.721412 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d0fd7271-8eb1-4b28-b00a-c54730e104b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:25.722344 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d0fd7271-8eb1-4b28-b00a-c54730e104b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:25.733765 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0fd7271-8eb1-4b28-b00a-c54730e104b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:25.734496 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0fd7271-8eb1-4b28-b00a-c54730e104b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:25.735794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0fd7271-8eb1-4b28-b00a-c54730e104b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:25.736505 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d0fd7271-8eb1-4b28-b00a-c54730e104b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:25.876685 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d0fd7271-8eb1-4b28-b00a-c54730e104b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:25.887457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d0fd7271-8eb1-4b28-b00a-c54730e104b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.172452 Jun 23 08:34:25.888053 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 608/1205] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:25 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:26.906652 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c8210301-62a5-4385-9d54-f24e5bfcc9cf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:26.907384 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c8210301-62a5-4385-9d54-f24e5bfcc9cf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:26.915792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c8210301-62a5-4385-9d54-f24e5bfcc9cf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:26.916322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c8210301-62a5-4385-9d54-f24e5bfcc9cf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:26.917214 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c8210301-62a5-4385-9d54-f24e5bfcc9cf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:26.917721 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c8210301-62a5-4385-9d54-f24e5bfcc9cf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:27.051423 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c8210301-62a5-4385-9d54-f24e5bfcc9cf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:27.060034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c8210301-62a5-4385-9d54-f24e5bfcc9cf tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.158058 Jun 23 08:34:27.060628 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 598/1206] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:26 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:28.087538 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d2996db8-ecd4-4269-acbf-c5d451bdeaa5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:28.088491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d2996db8-ecd4-4269-acbf-c5d451bdeaa5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:28.099642 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2996db8-ecd4-4269-acbf-c5d451bdeaa5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:28.100424 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2996db8-ecd4-4269-acbf-c5d451bdeaa5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:28.101816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2996db8-ecd4-4269-acbf-c5d451bdeaa5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:28.102250 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2996db8-ecd4-4269-acbf-c5d451bdeaa5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:28.250243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d2996db8-ecd4-4269-acbf-c5d451bdeaa5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:28.261774 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d2996db8-ecd4-4269-acbf-c5d451bdeaa5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.181296 Jun 23 08:34:28.262355 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 609/1207] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:28 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:29.283901 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-51498ffa-bcc9-4fba-8dfa-f197237ccd24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:29.284886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-51498ffa-bcc9-4fba-8dfa-f197237ccd24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:29.297238 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-51498ffa-bcc9-4fba-8dfa-f197237ccd24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:29.297981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-51498ffa-bcc9-4fba-8dfa-f197237ccd24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:29.299292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-51498ffa-bcc9-4fba-8dfa-f197237ccd24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:29.300048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-51498ffa-bcc9-4fba-8dfa-f197237ccd24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:29.442988 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-51498ffa-bcc9-4fba-8dfa-f197237ccd24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:29.455156 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-51498ffa-bcc9-4fba-8dfa-f197237ccd24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1723 microversion: 2.1 time: 0.177460 Jun 23 08:34:29.456034 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 599/1208] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:29 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:30.472515 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-94d8300a-c332-41d8-9fc6-79ea7533e198 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:30.473145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-94d8300a-c332-41d8-9fc6-79ea7533e198 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:30.480164 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94d8300a-c332-41d8-9fc6-79ea7533e198 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:30.480611 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94d8300a-c332-41d8-9fc6-79ea7533e198 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:30.481375 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94d8300a-c332-41d8-9fc6-79ea7533e198 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:30.481802 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-94d8300a-c332-41d8-9fc6-79ea7533e198 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:30.628405 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-94d8300a-c332-41d8-9fc6-79ea7533e198 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:30.637557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-94d8300a-c332-41d8-9fc6-79ea7533e198 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1700 microversion: 2.1 time: 0.169028 Jun 23 08:34:30.638128 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 610/1209] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:30 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1700 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:30.658722 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5d1c54fe-6b85-46b4-a642-efd255cee8b4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:34:30.666053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5d1c54fe-6b85-46b4-a642-efd255cee8b4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:30.666772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5d1c54fe-6b85-46b4-a642-efd255cee8b4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:30.729679 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5d1c54fe-6b85-46b4-a642-efd255cee8b4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Going to try to start instance {{(pid=117757) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 08:34:30.779529 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5d1c54fe-6b85-46b4-a642-efd255cee8b4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/action" status: 202 len: 0 microversion: 2.1 time: 0.124390 Jun 23 08:34:30.780044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 600/1210] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:34:30 2022] POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 08:34:30.788257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4ee49bbf-a981-4519-a158-35f708def617 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:30.788873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4ee49bbf-a981-4519-a158-35f708def617 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:30.795670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbf-a981-4519-a158-35f708def617 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:30.796138 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbf-a981-4519-a158-35f708def617 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:30.796897 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbf-a981-4519-a158-35f708def617 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:30.797331 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4ee49bbf-a981-4519-a158-35f708def617 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:30.935998 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4ee49bbf-a981-4519-a158-35f708def617 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:30.944213 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4ee49bbf-a981-4519-a158-35f708def617 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1709 microversion: 2.1 time: 0.159807 Jun 23 08:34:30.944798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 611/1211] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:30 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:31.967859 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-135354cb-3994-424b-8adc-ecbca9de4f35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:31.969010 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-135354cb-3994-424b-8adc-ecbca9de4f35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:31.979256 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-135354cb-3994-424b-8adc-ecbca9de4f35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:31.979721 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-135354cb-3994-424b-8adc-ecbca9de4f35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:31.980493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-135354cb-3994-424b-8adc-ecbca9de4f35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:31.980926 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-135354cb-3994-424b-8adc-ecbca9de4f35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:32.135297 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-135354cb-3994-424b-8adc-ecbca9de4f35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:32.144013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-135354cb-3994-424b-8adc-ecbca9de4f35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1709 microversion: 2.1 time: 0.184496 Jun 23 08:34:32.144586 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 601/1212] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:31 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1709 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:34:33.165761 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ddba501f-ab6e-4ef2-ba8d-1c7c1f6e5737 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:34:33.167002 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ddba501f-ab6e-4ef2-ba8d-1c7c1f6e5737 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:34:33.178483 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddba501f-ab6e-4ef2-ba8d-1c7c1f6e5737 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:33.179567 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddba501f-ab6e-4ef2-ba8d-1c7c1f6e5737 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:33.181172 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddba501f-ab6e-4ef2-ba8d-1c7c1f6e5737 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:34:33.181869 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ddba501f-ab6e-4ef2-ba8d-1c7c1f6e5737 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:34:33.334257 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ddba501f-ab6e-4ef2-ba8d-1c7c1f6e5737 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:34:33.347815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ddba501f-ab6e-4ef2-ba8d-1c7c1f6e5737 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1713 microversion: 2.1 time: 0.188714 Jun 23 08:34:33.349729 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 612/1213] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:34:33 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1713 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:19.864863 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-37531981-1797-4334-b008-f41c29823402 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:19.865462 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-37531981-1797-4334-b008-f41c29823402 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:19.867043 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-c07e067c-17c9-4d16-8115-b0312722fb91 req-95305c59-f715-4982-9c1a-e51c16b8ae34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab012304-0cdc-48ca-ba38-b0d8859deced", "tag": "ed94646a-fad2-4a1b-b7a9-fa9296d27eff"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:35:19.867779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=17 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:35:19.868791 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:35:19.871580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=20 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:35:19.872281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:35:19.874213 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-37531981-1797-4334-b008-f41c29823402 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:19.874984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-37531981-1797-4334-b008-f41c29823402 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:19.875852 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-37531981-1797-4334-b008-f41c29823402 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:19.876471 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-37531981-1797-4334-b008-f41c29823402 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:19.879356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c07e067c-17c9-4d16-8115-b0312722fb91 req-95305c59-f715-4982-9c1a-e51c16b8ae34 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:19.879832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-c07e067c-17c9-4d16-8115-b0312722fb91 req-95305c59-f715-4982-9c1a-e51c16b8ae34 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:19.891885 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-c07e067c-17c9-4d16-8115-b0312722fb91 req-95305c59-f715-4982-9c1a-e51c16b8ae34 service nova] Creating event network-changed:ed94646a-fad2-4a1b-b7a9-fa9296d27eff for instance ab012304-0cdc-48ca-ba38-b0d8859deced on hv-cinder-84721 Jun 23 08:35:19.897728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-c07e067c-17c9-4d16-8115-b0312722fb91 req-95305c59-f715-4982-9c1a-e51c16b8ae34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034251 Jun 23 08:35:19.898341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 613/1214] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:35:19.905622 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-37531981-1797-4334-b008-f41c29823402 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:35:19.999119 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-37531981-1797-4334-b008-f41c29823402 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 204 len: 0 microversion: 2.1 time: 0.138269 Jun 23 08:35:20.000534 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 602/1215] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:35:19 2022] DELETE /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:35:20.010875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-db760be8-96fc-40d6-a0ec-a6a68c98e507 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:20.011678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-db760be8-96fc-40d6-a0ec-a6a68c98e507 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:20.018051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db760be8-96fc-40d6-a0ec-a6a68c98e507 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:20.018566 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db760be8-96fc-40d6-a0ec-a6a68c98e507 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:20.019475 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db760be8-96fc-40d6-a0ec-a6a68c98e507 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:20.019967 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-db760be8-96fc-40d6-a0ec-a6a68c98e507 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:20.234316 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-db760be8-96fc-40d6-a0ec-a6a68c98e507 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:20.242830 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-db760be8-96fc-40d6-a0ec-a6a68c98e507 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1575 microversion: 2.1 time: 0.237069 Jun 23 08:35:20.243322 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 614/1216] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:20 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:21.262707 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8bcf72a0-7fe9-4123-858c-766834123563 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:21.263852 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8bcf72a0-7fe9-4123-858c-766834123563 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:21.271730 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8bcf72a0-7fe9-4123-858c-766834123563 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:21.272161 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8bcf72a0-7fe9-4123-858c-766834123563 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:21.272919 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8bcf72a0-7fe9-4123-858c-766834123563 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:21.273345 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8bcf72a0-7fe9-4123-858c-766834123563 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:21.508009 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8bcf72a0-7fe9-4123-858c-766834123563 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:21.516002 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8bcf72a0-7fe9-4123-858c-766834123563 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1575 microversion: 2.1 time: 0.258547 Jun 23 08:35:21.516573 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 603/1217] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:21 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:22.410511 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-8990f3f1-0375-4cf9-84da-1b0f13a4d3fb req-bbcc6477-a53c-4f21-b1e5-8319b6f32485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab012304-0cdc-48ca-ba38-b0d8859deced", "name": "network-vif-deleted", "tag": "ed94646a-fad2-4a1b-b7a9-fa9296d27eff"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:35:22.420418 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-8990f3f1-0375-4cf9-84da-1b0f13a4d3fb req-bbcc6477-a53c-4f21-b1e5-8319b6f32485 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:22.420854 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-8990f3f1-0375-4cf9-84da-1b0f13a4d3fb req-bbcc6477-a53c-4f21-b1e5-8319b6f32485 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:22.438169 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-8990f3f1-0375-4cf9-84da-1b0f13a4d3fb req-bbcc6477-a53c-4f21-b1e5-8319b6f32485 service nova] Creating event network-vif-deleted:ed94646a-fad2-4a1b-b7a9-fa9296d27eff for instance ab012304-0cdc-48ca-ba38-b0d8859deced on hv-cinder-84721 Jun 23 08:35:22.446684 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-8990f3f1-0375-4cf9-84da-1b0f13a4d3fb req-bbcc6477-a53c-4f21-b1e5-8319b6f32485 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039529 Jun 23 08:35:22.447832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 615/1218] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:35:22.533380 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-946034e8-5562-4c8b-bae3-fc7061edb468 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:22.534021 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-946034e8-5562-4c8b-bae3-fc7061edb468 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:22.541187 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-946034e8-5562-4c8b-bae3-fc7061edb468 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:22.541634 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-946034e8-5562-4c8b-bae3-fc7061edb468 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:22.542401 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-946034e8-5562-4c8b-bae3-fc7061edb468 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:22.542836 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-946034e8-5562-4c8b-bae3-fc7061edb468 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:22.613018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-946034e8-5562-4c8b-bae3-fc7061edb468 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:22.623493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-946034e8-5562-4c8b-bae3-fc7061edb468 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 200 len: 1222 microversion: 2.1 time: 0.093940 Jun 23 08:35:22.624061 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 604/1219] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:22 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:23.648775 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:23.649546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: ab012304-0cdc-48ca-ba38-b0d8859deced] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:23.656944 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:23.657492 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:23.658333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:23.658803 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:23.673964 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] HTTP exception thrown: Instance ab012304-0cdc-48ca-ba38-b0d8859deced could not be found. Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Request method failure captured: Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced HTTP/1.1 Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCOsN22peIZXu4ujs2LfOP6L9I61aqS9YJ5VnPD78jZbFbpxK1qjKly35BsAjgmBXbfKhjCrUh5pUkdUDhqd4nLPTSfQWdwX591duNykQAzQYQweZEajR2xv-jkUt4nxGRusfYutqzSMIHrGI51zYeuNjTX_VHI3SHgs4Dz52ntqeyE Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:35:23.676000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa6a422103704f6d982c2bc558b3387e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}] Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 8d661ea344d74681bb7206f203033c60 Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance ab012304-0cdc-48ca-ba38-b0d8859deced could not be found. Jun 23 08:35:23.677706 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'ab012304-0cdc-48ca-ba38-b0d8859deced'} Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab012304-0cdc-48ca-ba38-b0d8859deced could not be found. Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:35:23.678556 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab012304-0cdc-48ca-ba38-b0d8859deced could not be found. Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab012304-0cdc-48ca-ba38-b0d8859deced could not be found. Jun 23 08:35:23.679963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:23.681534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Returning 404 to user: Instance ab012304-0cdc-48ca-ba38-b0d8859deced could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:35:23.681534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-51e82b40-819b-4319-89b6-fc2c75e44038 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced" status: 404 len: 111 microversion: 2.1 time: 0.034555 Jun 23 08:35:23.681534 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 616/1220] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:23 2022] GET /compute/v2.1/servers/ab012304-0cdc-48ca-ba38-b0d8859deced => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:35:26.781178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-9f6cfa84-7398-49b4-9ba6-5b71272c0117 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:26.781823 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9f6cfa84-7398-49b4-9ba6-5b71272c0117 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:26.782420 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-986f3f0e-bbb2-445a-aa40-f71692d4f142 req-cd63db01-8087-4a0c-b90a-fa0c5e99f375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faeb680-1bfd-4cb9-9b19-7d35d58a25fe", "tag": "396de0ea-56ae-4b2c-9466-0e228410b8bb"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:35:26.788571 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa84-7398-49b4-9ba6-5b71272c0117 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:26.789253 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa84-7398-49b4-9ba6-5b71272c0117 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:26.790018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa84-7398-49b4-9ba6-5b71272c0117 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:26.790435 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-9f6cfa84-7398-49b4-9ba6-5b71272c0117 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:26.792772 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-986f3f0e-bbb2-445a-aa40-f71692d4f142 req-cd63db01-8087-4a0c-b90a-fa0c5e99f375 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:26.793455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-986f3f0e-bbb2-445a-aa40-f71692d4f142 req-cd63db01-8087-4a0c-b90a-fa0c5e99f375 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:26.806917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-986f3f0e-bbb2-445a-aa40-f71692d4f142 req-cd63db01-8087-4a0c-b90a-fa0c5e99f375 service nova] Creating event network-changed:396de0ea-56ae-4b2c-9466-0e228410b8bb for instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe on hv-cinder-84721 Jun 23 08:35:26.813000 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-986f3f0e-bbb2-445a-aa40-f71692d4f142 req-cd63db01-8087-4a0c-b90a-fa0c5e99f375 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033993 Jun 23 08:35:26.814168 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 617/1221] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:35:26.818735 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-9f6cfa84-7398-49b4-9ba6-5b71272c0117 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:35:26.907750 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-9f6cfa84-7398-49b4-9ba6-5b71272c0117 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 204 len: 0 microversion: 2.1 time: 0.130525 Jun 23 08:35:26.908425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 605/1222] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:35:26 2022] DELETE /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:35:26.918282 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-4c64a4f9-ef73-4c96-8288-8d7e8f153d5e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:26.918840 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-4c64a4f9-ef73-4c96-8288-8d7e8f153d5e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:26.925861 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4c64a4f9-ef73-4c96-8288-8d7e8f153d5e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:26.926411 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4c64a4f9-ef73-4c96-8288-8d7e8f153d5e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:26.927183 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4c64a4f9-ef73-4c96-8288-8d7e8f153d5e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:26.927641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-4c64a4f9-ef73-4c96-8288-8d7e8f153d5e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:27.060127 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-4c64a4f9-ef73-4c96-8288-8d7e8f153d5e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:27.068214 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-4c64a4f9-ef73-4c96-8288-8d7e8f153d5e tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1574 microversion: 2.1 time: 0.154504 Jun 23 08:35:27.068781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 618/1223] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:26 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:28.085702 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1aa150fd-6f93-4b10-93e9-0a6d37b536b9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:28.086370 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1aa150fd-6f93-4b10-93e9-0a6d37b536b9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:28.093229 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1aa150fd-6f93-4b10-93e9-0a6d37b536b9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:28.093911 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1aa150fd-6f93-4b10-93e9-0a6d37b536b9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:28.094666 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1aa150fd-6f93-4b10-93e9-0a6d37b536b9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:28.095112 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1aa150fd-6f93-4b10-93e9-0a6d37b536b9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:28.115393 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:35:28.115926 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Thu Jun 23 08:35:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:35:28.303325 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1aa150fd-6f93-4b10-93e9-0a6d37b536b9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d661ea344d74681bb7206f203033c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6a422103704f6d982c2bc558b3387e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:28.311339 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1aa150fd-6f93-4b10-93e9-0a6d37b536b9 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 200 len: 1455 microversion: 2.1 time: 0.229896 Jun 23 08:35:28.311920 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 606/1224] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:28 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 1455 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:28.413746 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-130af748-3b5a-44b0-a83b-bddd53ae9912 req-a6c8855d-5fd8-4ef2-b6c2-1e03cd0034fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1faeb680-1bfd-4cb9-9b19-7d35d58a25fe", "name": "network-vif-deleted", "tag": "396de0ea-56ae-4b2c-9466-0e228410b8bb"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:35:28.422848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-130af748-3b5a-44b0-a83b-bddd53ae9912 req-a6c8855d-5fd8-4ef2-b6c2-1e03cd0034fe service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:28.423319 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-130af748-3b5a-44b0-a83b-bddd53ae9912 req-a6c8855d-5fd8-4ef2-b6c2-1e03cd0034fe service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:28.434677 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-130af748-3b5a-44b0-a83b-bddd53ae9912 req-a6c8855d-5fd8-4ef2-b6c2-1e03cd0034fe service nova] Creating event network-vif-deleted:396de0ea-56ae-4b2c-9466-0e228410b8bb for instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe on hv-cinder-84721 Jun 23 08:35:28.439579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-130af748-3b5a-44b0-a83b-bddd53ae9912 req-a6c8855d-5fd8-4ef2-b6c2-1e03cd0034fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029484 Jun 23 08:35:28.440207 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 619/1225] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:35:29.328622 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:29.329243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:29.336424 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:29.336862 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:29.337601 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:29.338026 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:29.352111 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] HTTP exception thrown: Instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe could not be found. Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Request method failure captured: Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe HTTP/1.1 Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCOsN22peIZXu4ujs2LfOP6L9I61aqS9YJ5VnPD78jZbFbpxK1qjKly35BsAjgmBXbfKhjCrUh5pUkdUDhqd4nLPTSfQWdwX591duNykQAzQYQweZEajR2xv-jkUt4nxGRusfYutqzSMIHrGI51zYeuNjTX_VHI3SHgs4Dz52ntqeyE Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:35:29.353786 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa6a422103704f6d982c2bc558b3387e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}] Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 8d661ea344d74681bb7206f203033c60 Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe could not be found. Jun 23 08:35:29.355525 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '1faeb680-1bfd-4cb9-9b19-7d35d58a25fe'} Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe could not be found. Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:35:29.356493 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe could not be found. Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe could not be found. Jun 23 08:35:29.358200 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:29.359595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Returning 404 to user: Instance 1faeb680-1bfd-4cb9-9b19-7d35d58a25fe could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:35:29.359595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ecc083c8-f580-4fae-9525-11cfddd5ba1b tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe" status: 404 len: 111 microversion: 2.1 time: 0.030431 Jun 23 08:35:29.359595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 607/1226] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:29 2022] GET /compute/v2.1/servers/1faeb680-1bfd-4cb9-9b19-7d35d58a25fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:35:30.075828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:30.076432 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:30.083078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:30.083550 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:30.084338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:30.084769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:30.098516 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] HTTP exception thrown: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Request method failure captured: Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 HTTP/1.1 Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCOsN22peIZXu4ujs2LfOP6L9I61aqS9YJ5VnPD78jZbFbpxK1qjKly35BsAjgmBXbfKhjCrUh5pUkdUDhqd4nLPTSfQWdwX591duNykQAzQYQweZEajR2xv-jkUt4nxGRusfYutqzSMIHrGI51zYeuNjTX_VHI3SHgs4Dz52ntqeyE Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:35:30.100180 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa6a422103704f6d982c2bc558b3387e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}] Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 8d661ea344d74681bb7206f203033c60 Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.101682 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '220cbacb-32cd-462b-b1a3-55330d9b7513'} Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:35:30.102577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.104144 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.105792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Returning 404 to user: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:35:30.105792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-95078ee0-7f45-480b-ac61-ccb5f5ce4a24 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "DELETE /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 404 len: 111 microversion: 2.1 time: 0.030689 Jun 23 08:35:30.105792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 620/1227] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:35:30 2022] DELETE /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:35:30.110604 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:30.111261 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] [instance: 220cbacb-32cd-462b-b1a3-55330d9b7513] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:30.117822 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:30.118326 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:30.119562 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:30.119988 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:30.135346 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] HTTP exception thrown: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Request method failure captured: Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 HTTP/1.1 Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCOsN22peIZXu4ujs2LfOP6L9I61aqS9YJ5VnPD78jZbFbpxK1qjKly35BsAjgmBXbfKhjCrUh5pUkdUDhqd4nLPTSfQWdwX591duNykQAzQYQweZEajR2xv-jkUt4nxGRusfYutqzSMIHrGI51zYeuNjTX_VHI3SHgs4Dz52ntqeyE Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:35:30.136890 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa6a422103704f6d982c2bc558b3387e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa6a422103704f6d982c2bc558b3387e"}]}] Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: aa6a422103704f6d982c2bc558b3387e Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-TestVolumeBootPattern-710183039 Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 8d661ea344d74681bb7206f203033c60 Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-TestVolumeBootPattern-710183039-project Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.138538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '220cbacb-32cd-462b-b1a3-55330d9b7513'} Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:35:30.139765 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. Jun 23 08:35:30.141053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:35:30.142410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Returning 404 to user: Instance 220cbacb-32cd-462b-b1a3-55330d9b7513 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:35:30.142410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-3241d71b-6f72-4541-9df9-0829a9c71029 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513" status: 404 len: 111 microversion: 2.1 time: 0.031696 Jun 23 08:35:30.142410 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 608/1228] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:30 2022] GET /compute/v2.1/servers/220cbacb-32cd-462b-b1a3-55330d9b7513 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 08:35:31.449446 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8197967e-1f03-45fe-8416-0875f2d4ab02 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] Calling method '.version_select at 0x7feb6b7fb1f0>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:31.469553 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8197967e-1f03-45fe-8416-0875f2d4ab02 tempest-TestVolumeBootPattern-710183039 tempest-TestVolumeBootPattern-710183039-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-5901677" status: 202 len: 0 microversion: 2.1 time: 0.023907 Jun 23 08:35:31.473888 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 621/1229] 10.222.0.33 () {58 vars in 1253 bytes} [Thu Jun 23 08:35:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-5901677 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:35:36.595647 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-dd2da3c1-70ad-4767-ad5d-da1a384c8f4a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:36.596287 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-dd2da3c1-70ad-4767-ad5d-da1a384c8f4a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:36.603065 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dd2da3c1-70ad-4767-ad5d-da1a384c8f4a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:36.603549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dd2da3c1-70ad-4767-ad5d-da1a384c8f4a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:36.605746 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dd2da3c1-70ad-4767-ad5d-da1a384c8f4a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:36.606197 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-dd2da3c1-70ad-4767-ad5d-da1a384c8f4a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:36.691221 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-dd2da3c1-70ad-4767-ad5d-da1a384c8f4a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lazy-loading 'services' on Instance uuid 23522f32-f998-4da9-becd-a9025e7aa51f {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:35:36.771138 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-dd2da3c1-70ad-4767-ad5d-da1a384c8f4a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/os-volume_attachments/12cfa4af-7805-48f1-b6f2-109aa720028f" status: 202 len: 0 microversion: 2.1 time: 0.179331 Jun 23 08:35:36.771792 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 609/1230] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:35:36 2022] DELETE /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/os-volume_attachments/12cfa4af-7805-48f1-b6f2-109aa720028f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:35:37.887040 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-06ebb13b-dbc3-405b-a707-80593b0bcfc8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:35:37.894931 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-06ebb13b-dbc3-405b-a707-80593b0bcfc8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:37.895651 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-06ebb13b-dbc3-405b-a707-80593b0bcfc8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:37.919304 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-06ebb13b-dbc3-405b-a707-80593b0bcfc8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Going to try to stop instance {{(pid=117758) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 08:35:37.966793 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-06ebb13b-dbc3-405b-a707-80593b0bcfc8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/action" status: 202 len: 0 microversion: 2.1 time: 0.084909 Jun 23 08:35:37.967461 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 622/1231] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:35:37 2022] POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:35:37.976801 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8a59ca92-7986-4770-a197-dfd3cfbc18f3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:37.979131 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8a59ca92-7986-4770-a197-dfd3cfbc18f3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:37.987751 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8a59ca92-7986-4770-a197-dfd3cfbc18f3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:37.988124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8a59ca92-7986-4770-a197-dfd3cfbc18f3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:37.989048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8a59ca92-7986-4770-a197-dfd3cfbc18f3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:37.989511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8a59ca92-7986-4770-a197-dfd3cfbc18f3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:38.143107 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8a59ca92-7986-4770-a197-dfd3cfbc18f3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:38.151025 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8a59ca92-7986-4770-a197-dfd3cfbc18f3 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.179157 Jun 23 08:35:38.151620 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 610/1232] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:37 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:39.170025 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3038da97-59e2-401d-88bb-b15052763de5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:39.170636 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3038da97-59e2-401d-88bb-b15052763de5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:39.178323 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3038da97-59e2-401d-88bb-b15052763de5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:39.178764 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3038da97-59e2-401d-88bb-b15052763de5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:39.179582 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3038da97-59e2-401d-88bb-b15052763de5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:39.180009 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3038da97-59e2-401d-88bb-b15052763de5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:39.321045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3038da97-59e2-401d-88bb-b15052763de5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:39.329170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3038da97-59e2-401d-88bb-b15052763de5 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.164188 Jun 23 08:35:39.329742 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 623/1233] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:39 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:40.356734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e49601ad-a3d2-4a1d-bea9-418f0bce92b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:40.357806 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e49601ad-a3d2-4a1d-bea9-418f0bce92b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:40.367292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e49601ad-a3d2-4a1d-bea9-418f0bce92b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:40.367699 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e49601ad-a3d2-4a1d-bea9-418f0bce92b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:40.368476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e49601ad-a3d2-4a1d-bea9-418f0bce92b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:40.369241 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e49601ad-a3d2-4a1d-bea9-418f0bce92b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:40.504868 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e49601ad-a3d2-4a1d-bea9-418f0bce92b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:40.513046 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e49601ad-a3d2-4a1d-bea9-418f0bce92b8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.162621 Jun 23 08:35:40.513625 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 611/1234] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:40 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:41.530123 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1661186c-d271-4140-a017-b8dfdb71bab6 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:41.530763 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1661186c-d271-4140-a017-b8dfdb71bab6 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:41.537941 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1661186c-d271-4140-a017-b8dfdb71bab6 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:41.538377 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1661186c-d271-4140-a017-b8dfdb71bab6 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:41.539131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1661186c-d271-4140-a017-b8dfdb71bab6 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:41.539589 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1661186c-d271-4140-a017-b8dfdb71bab6 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:41.686117 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1661186c-d271-4140-a017-b8dfdb71bab6 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:41.697381 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1661186c-d271-4140-a017-b8dfdb71bab6 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.170871 Jun 23 08:35:41.698147 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 624/1235] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:41 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:42.719738 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8499b231-4d8f-4c09-b37b-4e68e199d180 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:42.720556 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8499b231-4d8f-4c09-b37b-4e68e199d180 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:42.729926 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8499b231-4d8f-4c09-b37b-4e68e199d180 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:42.730518 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8499b231-4d8f-4c09-b37b-4e68e199d180 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:42.731568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8499b231-4d8f-4c09-b37b-4e68e199d180 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:42.732170 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8499b231-4d8f-4c09-b37b-4e68e199d180 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:42.883753 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-8499b231-4d8f-4c09-b37b-4e68e199d180 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:42.891719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8499b231-4d8f-4c09-b37b-4e68e199d180 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.177154 Jun 23 08:35:42.892318 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 612/1236] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:42 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:43.913699 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1632eba9-b1dd-49e8-a49a-f1babf7762f8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:43.914654 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1632eba9-b1dd-49e8-a49a-f1babf7762f8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:43.925908 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1632eba9-b1dd-49e8-a49a-f1babf7762f8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:43.926644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1632eba9-b1dd-49e8-a49a-f1babf7762f8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:43.927471 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1632eba9-b1dd-49e8-a49a-f1babf7762f8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:43.927899 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1632eba9-b1dd-49e8-a49a-f1babf7762f8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:44.072005 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1632eba9-b1dd-49e8-a49a-f1babf7762f8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:44.083073 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1632eba9-b1dd-49e8-a49a-f1babf7762f8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.175737 Jun 23 08:35:44.083764 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 625/1237] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:43 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:45.102865 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6ea29640-bf3b-4d0b-929f-88af7746e018 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:45.103550 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-6ea29640-bf3b-4d0b-929f-88af7746e018 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:45.110485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6ea29640-bf3b-4d0b-929f-88af7746e018 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:45.110929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6ea29640-bf3b-4d0b-929f-88af7746e018 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:45.111732 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6ea29640-bf3b-4d0b-929f-88af7746e018 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:45.112163 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-6ea29640-bf3b-4d0b-929f-88af7746e018 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:45.258510 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-6ea29640-bf3b-4d0b-929f-88af7746e018 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:45.266502 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6ea29640-bf3b-4d0b-929f-88af7746e018 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.168442 Jun 23 08:35:45.267074 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 613/1238] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:45 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:46.288282 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f874ec68-7af4-48da-8d7a-851978648eaa tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:46.289237 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f874ec68-7af4-48da-8d7a-851978648eaa tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:46.300396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f874ec68-7af4-48da-8d7a-851978648eaa tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:46.301120 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f874ec68-7af4-48da-8d7a-851978648eaa tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:46.302756 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f874ec68-7af4-48da-8d7a-851978648eaa tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:46.303185 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f874ec68-7af4-48da-8d7a-851978648eaa tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:46.444248 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f874ec68-7af4-48da-8d7a-851978648eaa tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:46.452394 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f874ec68-7af4-48da-8d7a-851978648eaa tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.170535 Jun 23 08:35:46.452961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 626/1239] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:46 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:47.473600 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-388ad009-f22f-4f74-be71-3a4b1568ca09 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:47.474571 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-388ad009-f22f-4f74-be71-3a4b1568ca09 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:47.481925 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-388ad009-f22f-4f74-be71-3a4b1568ca09 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:47.482371 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-388ad009-f22f-4f74-be71-3a4b1568ca09 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:47.483137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-388ad009-f22f-4f74-be71-3a4b1568ca09 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:47.483595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-388ad009-f22f-4f74-be71-3a4b1568ca09 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:47.627902 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-388ad009-f22f-4f74-be71-3a4b1568ca09 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:47.639568 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-388ad009-f22f-4f74-be71-3a4b1568ca09 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1677 microversion: 2.1 time: 0.172141 Jun 23 08:35:47.640336 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 614/1240] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:47 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:48.668686 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-141dd595-f6d4-4a04-a12f-e00621235232 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:48.669733 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-141dd595-f6d4-4a04-a12f-e00621235232 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:48.679371 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-141dd595-f6d4-4a04-a12f-e00621235232 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:48.679823 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-141dd595-f6d4-4a04-a12f-e00621235232 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:48.680587 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-141dd595-f6d4-4a04-a12f-e00621235232 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:48.681017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-141dd595-f6d4-4a04-a12f-e00621235232 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:48.819045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-141dd595-f6d4-4a04-a12f-e00621235232 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:48.826833 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-141dd595-f6d4-4a04-a12f-e00621235232 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1654 microversion: 2.1 time: 0.164943 Jun 23 08:35:48.827427 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 627/1241] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:48 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:48.843106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-73149ea6-4fd2-4b2c-87f5-b428b9e487dc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:35:48.850246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-73149ea6-4fd2-4b2c-87f5-b428b9e487dc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:48.850737 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-73149ea6-4fd2-4b2c-87f5-b428b9e487dc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:48.872813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-73149ea6-4fd2-4b2c-87f5-b428b9e487dc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Going to try to start instance {{(pid=117757) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 08:35:48.877194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:35:48.919280 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-73149ea6-4fd2-4b2c-87f5-b428b9e487dc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/action" status: 202 len: 0 microversion: 2.1 time: 0.079841 Jun 23 08:35:48.920091 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 615/1242] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:35:48 2022] POST /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:35:48.928407 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7691ea47-901a-487d-88bd-96c1aa2bdddc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:48.929056 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7691ea47-901a-487d-88bd-96c1aa2bdddc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:48.935177 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7691ea47-901a-487d-88bd-96c1aa2bdddc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:48.935730 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7691ea47-901a-487d-88bd-96c1aa2bdddc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:48.936488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7691ea47-901a-487d-88bd-96c1aa2bdddc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:48.936911 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7691ea47-901a-487d-88bd-96c1aa2bdddc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:49.074747 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-7691ea47-901a-487d-88bd-96c1aa2bdddc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:49.083019 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7691ea47-901a-487d-88bd-96c1aa2bdddc tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1663 microversion: 2.1 time: 0.158676 Jun 23 08:35:49.083621 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 628/1243] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:48 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:50.105879 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d4674b91-b724-4e5a-9d01-b93386420c0e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:50.107053 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d4674b91-b724-4e5a-9d01-b93386420c0e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:50.110877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:35:50.119495 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4674b91-b724-4e5a-9d01-b93386420c0e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:50.119931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4674b91-b724-4e5a-9d01-b93386420c0e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:50.120680 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4674b91-b724-4e5a-9d01-b93386420c0e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:50.121105 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d4674b91-b724-4e5a-9d01-b93386420c0e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:50.266499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d4674b91-b724-4e5a-9d01-b93386420c0e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:50.275437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d4674b91-b724-4e5a-9d01-b93386420c0e tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1663 microversion: 2.1 time: 0.176655 Jun 23 08:35:50.276014 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 616/1244] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:50 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1663 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:35:51.298004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-f8a718c0-e617-43c4-9ca8-0f368988a4e1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:35:51.298969 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-f8a718c0-e617-43c4-9ca8-0f368988a4e1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:35:51.302793 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:35:51.312230 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f8a718c0-e617-43c4-9ca8-0f368988a4e1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:51.312950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f8a718c0-e617-43c4-9ca8-0f368988a4e1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:51.314206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f8a718c0-e617-43c4-9ca8-0f368988a4e1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:35:51.314917 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-f8a718c0-e617-43c4-9ca8-0f368988a4e1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:35:51.319955 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:35:51.466362 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-f8a718c0-e617-43c4-9ca8-0f368988a4e1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:35:51.474423 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-f8a718c0-e617-43c4-9ca8-0f368988a4e1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1667 microversion: 2.1 time: 0.182864 Jun 23 08:35:51.475030 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 629/1245] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:35:51 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1667 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:23.887115 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ba1e59d5-a33b-4db2-8d28-bee5dd218443 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:36:23.887826 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ba1e59d5-a33b-4db2-8d28-bee5dd218443 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:23.889998 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:36:23.890647 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:36:23.897262 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba1e59d5-a33b-4db2-8d28-bee5dd218443 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:23.897699 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba1e59d5-a33b-4db2-8d28-bee5dd218443 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:23.898610 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba1e59d5-a33b-4db2-8d28-bee5dd218443 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:23.899182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ba1e59d5-a33b-4db2-8d28-bee5dd218443 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:23.924018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.objects.instance [None req-ba1e59d5-a33b-4db2-8d28-bee5dd218443 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lazy-loading 'flavor' on Instance uuid f5eca28d-5c90-4969-8a73-702bc7738287 {{(pid=117757) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:36:24.007389 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ba1e59d5-a33b-4db2-8d28-bee5dd218443 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "POST /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287/action" status: 202 len: 0 microversion: 2.1 time: 0.124362 Jun 23 08:36:24.008057 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 617/1246] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:36:23 2022] POST /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:36:24.017079 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1d8f2498-b7d7-44ae-b495-4593e42f53a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:24.017728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1d8f2498-b7d7-44ae-b495-4593e42f53a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:24.019825 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:36:24.020481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=5 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:36:24.025794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d8f2498-b7d7-44ae-b495-4593e42f53a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:24.026277 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d8f2498-b7d7-44ae-b495-4593e42f53a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:24.027050 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d8f2498-b7d7-44ae-b495-4593e42f53a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:24.027546 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-1d8f2498-b7d7-44ae-b495-4593e42f53a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:24.176851 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1d8f2498-b7d7-44ae-b495-4593e42f53a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:24.188586 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1d8f2498-b7d7-44ae-b495-4593e42f53a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.175577 Jun 23 08:36:24.189463 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 630/1247] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:24 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:25.217943 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ce0befdc-a05f-46d9-93b2-c2a60dff3baa tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:25.219109 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ce0befdc-a05f-46d9-93b2-c2a60dff3baa tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:25.226490 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ce0befdc-a05f-46d9-93b2-c2a60dff3baa tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:25.226924 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ce0befdc-a05f-46d9-93b2-c2a60dff3baa tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:25.227709 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ce0befdc-a05f-46d9-93b2-c2a60dff3baa tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:25.228129 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ce0befdc-a05f-46d9-93b2-c2a60dff3baa tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:25.386389 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-ce0befdc-a05f-46d9-93b2-c2a60dff3baa tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:25.394499 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ce0befdc-a05f-46d9-93b2-c2a60dff3baa tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.184559 Jun 23 08:36:25.395069 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 618/1248] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:25 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:26.415764 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-90f1c91c-e412-491e-9dcc-87ccc6857175 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:26.416390 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-90f1c91c-e412-491e-9dcc-87ccc6857175 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:26.425664 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-90f1c91c-e412-491e-9dcc-87ccc6857175 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:26.426102 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-90f1c91c-e412-491e-9dcc-87ccc6857175 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:26.426856 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-90f1c91c-e412-491e-9dcc-87ccc6857175 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:26.427310 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-90f1c91c-e412-491e-9dcc-87ccc6857175 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:26.565314 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-90f1c91c-e412-491e-9dcc-87ccc6857175 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:26.572958 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-90f1c91c-e412-491e-9dcc-87ccc6857175 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.163507 Jun 23 08:36:26.573526 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 631/1249] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:26 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:27.594804 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e685b682-18a6-4e2f-8aa6-67b1cd9018db tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:27.595531 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e685b682-18a6-4e2f-8aa6-67b1cd9018db tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:27.603431 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e685b682-18a6-4e2f-8aa6-67b1cd9018db tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:27.603985 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e685b682-18a6-4e2f-8aa6-67b1cd9018db tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:27.604869 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e685b682-18a6-4e2f-8aa6-67b1cd9018db tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:27.605369 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e685b682-18a6-4e2f-8aa6-67b1cd9018db tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:27.749974 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e685b682-18a6-4e2f-8aa6-67b1cd9018db tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:27.758027 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e685b682-18a6-4e2f-8aa6-67b1cd9018db tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.170004 Jun 23 08:36:27.758612 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 619/1250] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:27 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:28.775741 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-3d0a4f5a-7780-44c9-8cac-6f697b9da6bc tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:28.776532 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-3d0a4f5a-7780-44c9-8cac-6f697b9da6bc tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:28.785684 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d0a4f5a-7780-44c9-8cac-6f697b9da6bc tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:28.786255 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d0a4f5a-7780-44c9-8cac-6f697b9da6bc tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:28.787812 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d0a4f5a-7780-44c9-8cac-6f697b9da6bc tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:28.788281 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-3d0a4f5a-7780-44c9-8cac-6f697b9da6bc tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:28.922145 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-3d0a4f5a-7780-44c9-8cac-6f697b9da6bc tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:28.930080 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-3d0a4f5a-7780-44c9-8cac-6f697b9da6bc tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.158231 Jun 23 08:36:28.930661 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 632/1251] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:28 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:29.951580 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d1b163fb-50ad-4b1b-a2f6-307356ad7c00 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:29.952505 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d1b163fb-50ad-4b1b-a2f6-307356ad7c00 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:29.964032 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d1b163fb-50ad-4b1b-a2f6-307356ad7c00 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:29.964768 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d1b163fb-50ad-4b1b-a2f6-307356ad7c00 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:29.966018 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d1b163fb-50ad-4b1b-a2f6-307356ad7c00 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:29.966727 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d1b163fb-50ad-4b1b-a2f6-307356ad7c00 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:30.109468 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d1b163fb-50ad-4b1b-a2f6-307356ad7c00 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:30.118021 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d1b163fb-50ad-4b1b-a2f6-307356ad7c00 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.172895 Jun 23 08:36:30.118588 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 620/1252] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:29 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:31.139854 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-12d36490-a7cd-4b14-9570-9f879e8990e8 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:31.140859 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-12d36490-a7cd-4b14-9570-9f879e8990e8 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:31.148206 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-12d36490-a7cd-4b14-9570-9f879e8990e8 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:31.148650 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-12d36490-a7cd-4b14-9570-9f879e8990e8 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:31.149404 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-12d36490-a7cd-4b14-9570-9f879e8990e8 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:31.149830 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-12d36490-a7cd-4b14-9570-9f879e8990e8 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:31.289625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-12d36490-a7cd-4b14-9570-9f879e8990e8 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:31.301020 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-12d36490-a7cd-4b14-9570-9f879e8990e8 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.167361 Jun 23 08:36:31.301828 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 633/1253] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:31 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:32.327783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-4643e2e2-3239-4b48-b07c-2331c5ba3720 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:32.328770 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-4643e2e2-3239-4b48-b07c-2331c5ba3720 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:32.337228 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4643e2e2-3239-4b48-b07c-2331c5ba3720 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:32.337659 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4643e2e2-3239-4b48-b07c-2331c5ba3720 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:32.338409 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4643e2e2-3239-4b48-b07c-2331c5ba3720 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:32.338830 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-4643e2e2-3239-4b48-b07c-2331c5ba3720 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:32.477239 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-4643e2e2-3239-4b48-b07c-2331c5ba3720 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:32.486361 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-4643e2e2-3239-4b48-b07c-2331c5ba3720 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.164240 Jun 23 08:36:32.486361 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 621/1254] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:32 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:33.503395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b8defb21-d011-42d3-9a10-bcbe9ed07ca1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:33.504040 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b8defb21-d011-42d3-9a10-bcbe9ed07ca1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:33.510954 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b8defb21-d011-42d3-9a10-bcbe9ed07ca1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:33.511440 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b8defb21-d011-42d3-9a10-bcbe9ed07ca1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:33.512198 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b8defb21-d011-42d3-9a10-bcbe9ed07ca1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:33.512621 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b8defb21-d011-42d3-9a10-bcbe9ed07ca1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:33.659430 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b8defb21-d011-42d3-9a10-bcbe9ed07ca1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:33.671125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b8defb21-d011-42d3-9a10-bcbe9ed07ca1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.171761 Jun 23 08:36:33.672094 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 634/1255] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:33 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:34.694497 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a92e19a6-9086-4dce-8795-8d7f5e3f05a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:34.695124 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a92e19a6-9086-4dce-8795-8d7f5e3f05a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:34.704828 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a92e19a6-9086-4dce-8795-8d7f5e3f05a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:34.705277 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a92e19a6-9086-4dce-8795-8d7f5e3f05a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:34.706076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a92e19a6-9086-4dce-8795-8d7f5e3f05a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:34.706476 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a92e19a6-9086-4dce-8795-8d7f5e3f05a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:34.897143 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a92e19a6-9086-4dce-8795-8d7f5e3f05a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:34.909700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a92e19a6-9086-4dce-8795-8d7f5e3f05a9 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.218834 Jun 23 08:36:34.910436 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 622/1256] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:34 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:35.932578 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b6c6b650-9628-40b8-a19e-1573b4c0d594 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:35.933199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b6c6b650-9628-40b8-a19e-1573b4c0d594 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:35.942245 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b6c6b650-9628-40b8-a19e-1573b4c0d594 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:35.942692 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b6c6b650-9628-40b8-a19e-1573b4c0d594 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:35.943449 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b6c6b650-9628-40b8-a19e-1573b4c0d594 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:35.943912 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b6c6b650-9628-40b8-a19e-1573b4c0d594 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:36.094159 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-b6c6b650-9628-40b8-a19e-1573b4c0d594 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:36.106667 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b6c6b650-9628-40b8-a19e-1573b4c0d594 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.179504 Jun 23 08:36:36.107557 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 635/1257] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:35 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:37.126004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-66dd707e-bfce-402e-8415-3d33c9c717f1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:37.126609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-66dd707e-bfce-402e-8415-3d33c9c717f1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:37.133773 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-66dd707e-bfce-402e-8415-3d33c9c717f1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:37.133982 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-66dd707e-bfce-402e-8415-3d33c9c717f1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:37.134955 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-66dd707e-bfce-402e-8415-3d33c9c717f1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:37.135595 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-66dd707e-bfce-402e-8415-3d33c9c717f1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:37.281549 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-66dd707e-bfce-402e-8415-3d33c9c717f1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:37.289718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-66dd707e-bfce-402e-8415-3d33c9c717f1 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.167613 Jun 23 08:36:37.290290 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 623/1258] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:37 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:38.311944 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c89bea0f-b67b-4a51-a17b-b4d39c3cd350 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:38.312927 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c89bea0f-b67b-4a51-a17b-b4d39c3cd350 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:38.324406 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c89bea0f-b67b-4a51-a17b-b4d39c3cd350 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:38.325161 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c89bea0f-b67b-4a51-a17b-b4d39c3cd350 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:38.326412 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c89bea0f-b67b-4a51-a17b-b4d39c3cd350 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:38.327131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c89bea0f-b67b-4a51-a17b-b4d39c3cd350 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:38.472248 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c89bea0f-b67b-4a51-a17b-b4d39c3cd350 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:38.480586 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c89bea0f-b67b-4a51-a17b-b4d39c3cd350 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1509 microversion: 2.1 time: 0.175255 Jun 23 08:36:38.481159 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 636/1259] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:38 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:38.498086 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1b3eb240-4cb5-4352-ae24-9570c3a11f07 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:36:38.498669 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1b3eb240-4cb5-4352-ae24-9570c3a11f07 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:38.505771 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1b3eb240-4cb5-4352-ae24-9570c3a11f07 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:38.506216 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1b3eb240-4cb5-4352-ae24-9570c3a11f07 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:38.506981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1b3eb240-4cb5-4352-ae24-9570c3a11f07 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:38.507488 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1b3eb240-4cb5-4352-ae24-9570c3a11f07 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:38.591645 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1b3eb240-4cb5-4352-ae24-9570c3a11f07 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "POST /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287/action" status: 202 len: 0 microversion: 2.1 time: 0.097672 Jun 23 08:36:38.592156 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 624/1260] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 08:36:38 2022] POST /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:36:38.600246 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-468f9a88-68ca-4826-86df-a1669045b45d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:38.600848 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-468f9a88-68ca-4826-86df-a1669045b45d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:38.607042 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-468f9a88-68ca-4826-86df-a1669045b45d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:38.607576 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-468f9a88-68ca-4826-86df-a1669045b45d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:38.608350 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-468f9a88-68ca-4826-86df-a1669045b45d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:38.608772 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-468f9a88-68ca-4826-86df-a1669045b45d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:38.780846 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-468f9a88-68ca-4826-86df-a1669045b45d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:38.789344 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-468f9a88-68ca-4826-86df-a1669045b45d tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1517 microversion: 2.1 time: 0.192888 Jun 23 08:36:38.790118 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 637/1261] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:38 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:39.491033 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-641d195f-9187-4573-9c0d-2882194b61b6 req-cb1b0178-b894-485a-8526-9a2839b17913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5eca28d-5c90-4969-8a73-702bc7738287", "name": "network-vif-unplugged", "status": "completed", "tag": "7097fd07-3267-400c-858a-3201571bf146"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:36:39.500264 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-641d195f-9187-4573-9c0d-2882194b61b6 req-cb1b0178-b894-485a-8526-9a2839b17913 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:39.502351 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-641d195f-9187-4573-9c0d-2882194b61b6 req-cb1b0178-b894-485a-8526-9a2839b17913 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:39.517451 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.compute.server_external_events [req-641d195f-9187-4573-9c0d-2882194b61b6 req-cb1b0178-b894-485a-8526-9a2839b17913 service nova] Unable to find a host for instance f5eca28d-5c90-4969-8a73-702bc7738287. Dropping event network-vif-unplugged {{(pid=117757) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 08:36:39.518336 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-641d195f-9187-4573-9c0d-2882194b61b6 req-cb1b0178-b894-485a-8526-9a2839b17913 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031558 Jun 23 08:36:39.518908 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 625/1262] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 08:36:39.806681 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ed5806d0-5e6c-4ed0-be83-036cf3819150 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:39.807289 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ed5806d0-5e6c-4ed0-be83-036cf3819150 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:39.814054 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ed5806d0-5e6c-4ed0-be83-036cf3819150 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:39.814494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ed5806d0-5e6c-4ed0-be83-036cf3819150 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:39.815318 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ed5806d0-5e6c-4ed0-be83-036cf3819150 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:39.815868 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ed5806d0-5e6c-4ed0-be83-036cf3819150 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:39.954693 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ed5806d0-5e6c-4ed0-be83-036cf3819150 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:39.963393 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ed5806d0-5e6c-4ed0-be83-036cf3819150 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1519 microversion: 2.1 time: 0.160739 Jun 23 08:36:39.963975 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 638/1263] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:39 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:40.981674 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-1a8746cf-5d61-4af5-9aa2-b1a32046b017 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:40.982291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-1a8746cf-5d61-4af5-9aa2-b1a32046b017 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:40.989106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a8746cf-5d61-4af5-9aa2-b1a32046b017 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:40.989542 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a8746cf-5d61-4af5-9aa2-b1a32046b017 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:40.990292 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a8746cf-5d61-4af5-9aa2-b1a32046b017 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:40.990714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-1a8746cf-5d61-4af5-9aa2-b1a32046b017 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:41.124110 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-1a8746cf-5d61-4af5-9aa2-b1a32046b017 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:41.132378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-1a8746cf-5d61-4af5-9aa2-b1a32046b017 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.154388 Jun 23 08:36:41.132930 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 626/1264] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:40 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:42.150264 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-327d234b-aa7c-40c5-a34f-b8607886c282 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:42.151030 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-327d234b-aa7c-40c5-a34f-b8607886c282 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:42.161327 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-327d234b-aa7c-40c5-a34f-b8607886c282 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:42.161984 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-327d234b-aa7c-40c5-a34f-b8607886c282 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:42.163243 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-327d234b-aa7c-40c5-a34f-b8607886c282 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:42.164768 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-327d234b-aa7c-40c5-a34f-b8607886c282 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:42.311481 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-327d234b-aa7c-40c5-a34f-b8607886c282 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:42.319167 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-327d234b-aa7c-40c5-a34f-b8607886c282 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.172842 Jun 23 08:36:42.319786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 639/1265] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:42 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:43.340893 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2251164d-476e-4876-a7e8-337db368610a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:43.341875 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2251164d-476e-4876-a7e8-337db368610a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:43.352291 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2251164d-476e-4876-a7e8-337db368610a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:43.352739 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2251164d-476e-4876-a7e8-337db368610a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:43.353507 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2251164d-476e-4876-a7e8-337db368610a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:43.353940 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2251164d-476e-4876-a7e8-337db368610a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:43.498437 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2251164d-476e-4876-a7e8-337db368610a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:43.511184 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2251164d-476e-4876-a7e8-337db368610a tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.176976 Jun 23 08:36:43.512316 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 627/1266] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:43 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:44.532402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5e61f1c9-afcc-48f5-9748-978882d5b25c tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:44.532991 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-5e61f1c9-afcc-48f5-9748-978882d5b25c tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:44.540051 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5e61f1c9-afcc-48f5-9748-978882d5b25c tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:44.540462 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5e61f1c9-afcc-48f5-9748-978882d5b25c tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:44.541218 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5e61f1c9-afcc-48f5-9748-978882d5b25c tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:44.541644 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-5e61f1c9-afcc-48f5-9748-978882d5b25c tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:44.678484 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-5e61f1c9-afcc-48f5-9748-978882d5b25c tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:44.690087 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5e61f1c9-afcc-48f5-9748-978882d5b25c tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.161337 Jun 23 08:36:44.690760 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 640/1267] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:44 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:45.711055 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d2cf23f9-5394-4860-89e9-e66dcc767b70 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:45.711671 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d2cf23f9-5394-4860-89e9-e66dcc767b70 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:45.718857 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d2cf23f9-5394-4860-89e9-e66dcc767b70 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:45.719321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d2cf23f9-5394-4860-89e9-e66dcc767b70 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:45.720076 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d2cf23f9-5394-4860-89e9-e66dcc767b70 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:45.720650 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d2cf23f9-5394-4860-89e9-e66dcc767b70 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:45.865693 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d2cf23f9-5394-4860-89e9-e66dcc767b70 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:45.874255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d2cf23f9-5394-4860-89e9-e66dcc767b70 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.169205 Jun 23 08:36:45.874827 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 628/1268] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:45 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:46.895911 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c48b3067-6d6c-4da5-a9ac-7ee2cba69841 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:46.896935 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c48b3067-6d6c-4da5-a9ac-7ee2cba69841 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:46.908426 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c48b3067-6d6c-4da5-a9ac-7ee2cba69841 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:46.909263 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c48b3067-6d6c-4da5-a9ac-7ee2cba69841 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:46.910523 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c48b3067-6d6c-4da5-a9ac-7ee2cba69841 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:46.911269 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c48b3067-6d6c-4da5-a9ac-7ee2cba69841 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:47.051187 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c48b3067-6d6c-4da5-a9ac-7ee2cba69841 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:47.060608 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c48b3067-6d6c-4da5-a9ac-7ee2cba69841 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.171082 Jun 23 08:36:47.061484 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 641/1269] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:46 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:48.078518 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d887b30c-6e8d-4885-84c3-fc9a89de3390 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:48.079107 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d887b30c-6e8d-4885-84c3-fc9a89de3390 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:48.086342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d887b30c-6e8d-4885-84c3-fc9a89de3390 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:48.086775 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d887b30c-6e8d-4885-84c3-fc9a89de3390 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:48.087563 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d887b30c-6e8d-4885-84c3-fc9a89de3390 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:48.087979 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d887b30c-6e8d-4885-84c3-fc9a89de3390 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:48.223691 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-d887b30c-6e8d-4885-84c3-fc9a89de3390 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:48.234164 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d887b30c-6e8d-4885-84c3-fc9a89de3390 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.159549 Jun 23 08:36:48.234741 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 629/1270] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:48 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:49.252036 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-57b2bab1-7763-4c1b-84cc-f279f54285d3 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:49.252632 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-57b2bab1-7763-4c1b-84cc-f279f54285d3 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:49.260096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-57b2bab1-7763-4c1b-84cc-f279f54285d3 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:49.260541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-57b2bab1-7763-4c1b-84cc-f279f54285d3 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:49.261294 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-57b2bab1-7763-4c1b-84cc-f279f54285d3 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:49.261734 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-57b2bab1-7763-4c1b-84cc-f279f54285d3 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:49.401844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-57b2bab1-7763-4c1b-84cc-f279f54285d3 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:49.409769 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-57b2bab1-7763-4c1b-84cc-f279f54285d3 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.161667 Jun 23 08:36:49.410341 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 642/1271] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:49 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:50.431246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-aeee9e7d-3281-491a-8182-4dadc588cc0b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:50.431838 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-aeee9e7d-3281-491a-8182-4dadc588cc0b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:50.438726 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-aeee9e7d-3281-491a-8182-4dadc588cc0b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:50.439162 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-aeee9e7d-3281-491a-8182-4dadc588cc0b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:50.439942 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-aeee9e7d-3281-491a-8182-4dadc588cc0b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:50.440362 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-aeee9e7d-3281-491a-8182-4dadc588cc0b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:50.578071 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-aeee9e7d-3281-491a-8182-4dadc588cc0b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:50.586182 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-aeee9e7d-3281-491a-8182-4dadc588cc0b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.160974 Jun 23 08:36:50.586909 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 630/1272] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:50 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:51.588819 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-35a797c2-82d1-47d9-b7f5-04b0de69ce0e req-58636ae7-9b92-4f63-ab09-4e82899c6d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5eca28d-5c90-4969-8a73-702bc7738287", "name": "network-vif-plugged", "status": "completed", "tag": "7097fd07-3267-400c-858a-3201571bf146"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:36:51.598021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-35a797c2-82d1-47d9-b7f5-04b0de69ce0e req-58636ae7-9b92-4f63-ab09-4e82899c6d4b service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:51.598435 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-35a797c2-82d1-47d9-b7f5-04b0de69ce0e req-58636ae7-9b92-4f63-ab09-4e82899c6d4b service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:51.602961 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-96e3dcf4-80ba-49d2-9e3a-e8aa76b7136f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:51.604235 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-96e3dcf4-80ba-49d2-9e3a-e8aa76b7136f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:51.611267 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-96e3dcf4-80ba-49d2-9e3a-e8aa76b7136f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:51.612106 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-96e3dcf4-80ba-49d2-9e3a-e8aa76b7136f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:51.613087 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-96e3dcf4-80ba-49d2-9e3a-e8aa76b7136f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:51.613212 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-35a797c2-82d1-47d9-b7f5-04b0de69ce0e req-58636ae7-9b92-4f63-ab09-4e82899c6d4b service nova] Creating event network-vif-plugged:7097fd07-3267-400c-858a-3201571bf146 for instance f5eca28d-5c90-4969-8a73-702bc7738287 on hv-cinder-84721 Jun 23 08:36:51.613821 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-96e3dcf4-80ba-49d2-9e3a-e8aa76b7136f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:51.618272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-35a797c2-82d1-47d9-b7f5-04b0de69ce0e req-58636ae7-9b92-4f63-ab09-4e82899c6d4b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033542 Jun 23 08:36:51.618565 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:36:51.619555 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 643/1273] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:36:51.753228 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-96e3dcf4-80ba-49d2-9e3a-e8aa76b7136f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:51.761125 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-96e3dcf4-80ba-49d2-9e3a-e8aa76b7136f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.162279 Jun 23 08:36:51.761686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 631/1274] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:51 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:36:52.784063 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-89687c21-acf9-42b7-9a64-31b595ab7fbe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:52.785196 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-89687c21-acf9-42b7-9a64-31b595ab7fbe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:52.796289 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89687c21-acf9-42b7-9a64-31b595ab7fbe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:52.797027 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89687c21-acf9-42b7-9a64-31b595ab7fbe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:52.798271 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89687c21-acf9-42b7-9a64-31b595ab7fbe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:52.798989 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89687c21-acf9-42b7-9a64-31b595ab7fbe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:52.940125 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-89687c21-acf9-42b7-9a64-31b595ab7fbe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:52.948455 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-89687c21-acf9-42b7-9a64-31b595ab7fbe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1575 microversion: 2.1 time: 0.172212 Jun 23 08:36:52.949029 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 644/1275] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:52 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:53.971283 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-454c12ff-28f1-4887-b072-1c547d6d2a75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:53.972322 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-454c12ff-28f1-4887-b072-1c547d6d2a75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:53.975936 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=33 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:36:53.983321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-454c12ff-28f1-4887-b072-1c547d6d2a75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:53.983757 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-454c12ff-28f1-4887-b072-1c547d6d2a75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:53.984509 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-454c12ff-28f1-4887-b072-1c547d6d2a75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:53.984927 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-454c12ff-28f1-4887-b072-1c547d6d2a75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:54.136907 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-454c12ff-28f1-4887-b072-1c547d6d2a75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:54.144732 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-454c12ff-28f1-4887-b072-1c547d6d2a75 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1562 microversion: 2.1 time: 0.180147 Jun 23 08:36:54.145299 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 632/1276] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:53 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1562 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:54.845096 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-7caf9272-394c-4ae5-a9b2-52d0b4bcba45 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:54.846017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-7caf9272-394c-4ae5-a9b2-52d0b4bcba45 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:54.848464 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=31 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:36:54.853734 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7caf9272-394c-4ae5-a9b2-52d0b4bcba45 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:54.854170 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7caf9272-394c-4ae5-a9b2-52d0b4bcba45 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:54.854921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7caf9272-394c-4ae5-a9b2-52d0b4bcba45 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:54.855443 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-7caf9272-394c-4ae5-a9b2-52d0b4bcba45 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:54.857952 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=87 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:36:54.885585 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-7caf9272-394c-4ae5-a9b2-52d0b4bcba45 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044369 Jun 23 08:36:54.886270 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 645/1277] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:36:54 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:36:54.948435 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-05b2f3e6-ffcf-4d9e-acab-2f8e56938ed2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:54.949694 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-05b2f3e6-ffcf-4d9e-acab-2f8e56938ed2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:54.956132 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-05b2f3e6-ffcf-4d9e-acab-2f8e56938ed2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:54.956574 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-05b2f3e6-ffcf-4d9e-acab-2f8e56938ed2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:54.957335 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-05b2f3e6-ffcf-4d9e-acab-2f8e56938ed2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:54.957764 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-05b2f3e6-ffcf-4d9e-acab-2f8e56938ed2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:54.982271 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-05b2f3e6-ffcf-4d9e-acab-2f8e56938ed2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:36:55.076787 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-05b2f3e6-ffcf-4d9e-acab-2f8e56938ed2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 204 len: 0 microversion: 2.1 time: 0.134347 Jun 23 08:36:55.077782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 633/1278] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:36:54 2022] DELETE /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:36:55.087409 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-8f7365ae-f143-44f7-966e-c9fecf547111 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:55.088014 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-8f7365ae-f143-44f7-966e-c9fecf547111 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:55.099496 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f7365ae-f143-44f7-966e-c9fecf547111 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:55.099942 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f7365ae-f143-44f7-966e-c9fecf547111 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:55.100713 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f7365ae-f143-44f7-966e-c9fecf547111 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:55.101139 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-8f7365ae-f143-44f7-966e-c9fecf547111 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:55.234162 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-8f7365ae-f143-44f7-966e-c9fecf547111 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:55.241815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-8f7365ae-f143-44f7-966e-c9fecf547111 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1673 microversion: 2.1 time: 0.158336 Jun 23 08:36:55.242376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 646/1279] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:55 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:56.264051 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-e070ac5f-3605-472f-8137-cb7d10a2f86d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:56.264843 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-e070ac5f-3605-472f-8137-cb7d10a2f86d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:56.273102 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e070ac5f-3605-472f-8137-cb7d10a2f86d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:56.273618 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e070ac5f-3605-472f-8137-cb7d10a2f86d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:56.274495 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e070ac5f-3605-472f-8137-cb7d10a2f86d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:56.274992 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-e070ac5f-3605-472f-8137-cb7d10a2f86d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:56.416251 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-e070ac5f-3605-472f-8137-cb7d10a2f86d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:56.424955 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-e070ac5f-3605-472f-8137-cb7d10a2f86d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1673 microversion: 2.1 time: 0.167263 Jun 23 08:36:56.425563 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 634/1280] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:56 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:57.447488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d54417a2-b8c6-4061-87a1-1d067fe3b856 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:57.448078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d54417a2-b8c6-4061-87a1-1d067fe3b856 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:57.455696 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d54417a2-b8c6-4061-87a1-1d067fe3b856 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:57.456204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d54417a2-b8c6-4061-87a1-1d067fe3b856 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:57.456989 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d54417a2-b8c6-4061-87a1-1d067fe3b856 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:57.457402 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d54417a2-b8c6-4061-87a1-1d067fe3b856 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:57.586987 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d54417a2-b8c6-4061-87a1-1d067fe3b856 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:36:57.595163 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d54417a2-b8c6-4061-87a1-1d067fe3b856 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 200 len: 1673 microversion: 2.1 time: 0.151740 Jun 23 08:36:57.595766 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 647/1281] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:57 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:36:57.798366 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:36:57.799113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Thu Jun 23 08:36:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:36:58.139096 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-1df7dd56-7adc-4f55-8123-4afaed693f82 req-1d1be148-2fd1-4baa-a512-ffcf39e919a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23522f32-f998-4da9-becd-a9025e7aa51f", "name": "network-vif-deleted", "tag": "7cb06001-8150-4b24-a798-8cf3df9b607b"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:36:58.151478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-1df7dd56-7adc-4f55-8123-4afaed693f82 req-1d1be148-2fd1-4baa-a512-ffcf39e919a3 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:58.152417 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-1df7dd56-7adc-4f55-8123-4afaed693f82 req-1d1be148-2fd1-4baa-a512-ffcf39e919a3 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:58.166031 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-1df7dd56-7adc-4f55-8123-4afaed693f82 req-1d1be148-2fd1-4baa-a512-ffcf39e919a3 service nova] Creating event network-vif-deleted:7cb06001-8150-4b24-a798-8cf3df9b607b for instance 23522f32-f998-4da9-becd-a9025e7aa51f on hv-cinder-84721 Jun 23 08:36:58.172485 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-1df7dd56-7adc-4f55-8123-4afaed693f82 req-1d1be148-2fd1-4baa-a512-ffcf39e919a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107303 Jun 23 08:36:58.174098 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 635/1282] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:36:58.613101 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:58.614352 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:36:58.622712 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:58.623796 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:58.625004 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:36:58.625705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:36:58.642067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] HTTP exception thrown: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Request method failure captured: Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f HTTP/1.1 Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCUMM9Q7O7rIF1bj8Lc8E9su-uMlQ-Cf6bMvRaF56eW7N4LCt27pb73YyH4d_SbhTZuwFrifQdw65rs3kHc5l8cj-N9YcWd3621ZiTZbcbri_7E5AZSabpqGxGnuytoE98yuDjHtwQyWrh-T3YQPcaQr__UbXyt3_zR2IayM1EJ9qpU Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:36:58.643794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e27862b1b0f2434d86d6af9998716432", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}] Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 4ab1ccac328d47c99119b8205cabfedd Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:36:58.645395 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '23522f32-f998-4da9-becd-a9025e7aa51f'} Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:36:58.646332 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:36:58.647847 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:36:58.649140 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Returning 404 to user: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:36:58.649140 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-79a693f5-d911-409f-90a4-03fced48e5db tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 404 len: 111 microversion: 2.1 time: 0.036530 Jun 23 08:36:58.649140 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 648/1283] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:36:58 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:36:58.655341 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-57dabcbd-b549-4548-ba58-3622be245e2c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '.version_select at 0x7feb681cd9d0>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:36:58.688038 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-57dabcbd-b549-4548-ba58-3622be245e2c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501743413" status: 202 len: 0 microversion: 2.1 time: 0.037202 Jun 23 08:36:58.688627 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 636/1284] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 23 08:36:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501743413 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:36:59.370943 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-5498a3d5-258d-4bfc-b677-9acd804d8065 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'create', calling method: .version_select at 0x7feb62f84670>, body: {"keypair": {"name": "tempest-keypair-773430328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMt7nFZ6ucX9O7G9VMQCtzhnsUs+eD/E5M1dkksg3dsxpl8mKv3Fq9ZdtYyeLasSnk2VlemXbjTys5ujJU4SdluKTcTg2WI5vi9I/9HToyXZVcI4ZKIV7oUGW9wQcIGq7Q=="}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:36:59.390672 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-5498a3d5-258d-4bfc-b677-9acd804d8065 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Getting quotas for project e27862b1b0f2434d86d6af9998716432. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:36:59.394482 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.quota [None req-5498a3d5-258d-4bfc-b677-9acd804d8065 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Getting quotas for user 4ab1ccac328d47c99119b8205cabfedd and project e27862b1b0f2434d86d6af9998716432. Resources: {'key_pairs'} {{(pid=117758) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:36:59.417037 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-5498a3d5-258d-4bfc-b677-9acd804d8065 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052724 Jun 23 08:36:59.417862 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 649/1285] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 08:36:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:37:01.009528 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1780189286", "imageRef": "c7fb1ecf-837d-4e82-9dd7-73a854f64359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7266267-7981-404f-999b-51d6ce27aceb"}], "security_groups": [{"name": "tempest-securitygroup--318155422"}], "key_name": "tempest-keypair-773430328", "user_data": "}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:37:01.115511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.network.neutron [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] validate_networks() for [('b7266267-7981-404f-999b-51d6ce27aceb', None, None, None, None, None)] {{(pid=117757) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 08:37:01.493702 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Flavor limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 08:37:01.494113 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Image limits 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 08:37:01.494946 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Flavor pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 08:37:01.495372 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Image pref 0:0:0 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 08:37:01.495769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.virt.hardware [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117757) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 08:37:01.505711 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:01.506151 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:01.506944 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:01.507412 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:01.525473 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Getting quotas for project e27862b1b0f2434d86d6af9998716432. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 08:37:01.529526 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.quota [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Getting quotas for user 4ab1ccac328d47c99119b8205cabfedd and project e27862b1b0f2434d86d6af9998716432. Resources: {'ram', 'cores', 'instances'} {{(pid=117757) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 08:37:01.540546 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Going to run 1 instances... {{(pid=117757) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 08:37:01.542932 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7fb1ecf-837d-4e82-9dd7-73a854f64359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117757) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 08:37:01.602903 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-ad056f0c-edb3-40c3-98a5-4852c320f923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.597564 Jun 23 08:37:01.603769 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 637/1286] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 08:37:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 08:37:01.615526 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-1dbeb9e9-e6bb-411d-8a4f-7ccbfc1e2cdd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:01.616106 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-1dbeb9e9-e6bb-411d-8a4f-7ccbfc1e2cdd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:01.671526 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-1dbeb9e9-e6bb-411d-8a4f-7ccbfc1e2cdd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:01.678809 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-1dbeb9e9-e6bb-411d-8a4f-7ccbfc1e2cdd tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1237 microversion: 2.1 time: 0.067934 Jun 23 08:37:01.679488 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 650/1287] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:01 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:02.696790 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-0569fafd-4eed-440c-9de8-0a6da14385ec tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:02.697675 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-0569fafd-4eed-440c-9de8-0a6da14385ec tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:02.704723 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0569fafd-4eed-440c-9de8-0a6da14385ec tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:02.705155 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0569fafd-4eed-440c-9de8-0a6da14385ec tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:02.705931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0569fafd-4eed-440c-9de8-0a6da14385ec tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:02.706511 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-0569fafd-4eed-440c-9de8-0a6da14385ec tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:02.931794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-0569fafd-4eed-440c-9de8-0a6da14385ec tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:02.939783 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-0569fafd-4eed-440c-9de8-0a6da14385ec tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1307 microversion: 2.1 time: 0.247508 Jun 23 08:37:02.940572 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 638/1288] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:02 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:03.957376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-c34f9932-4b94-45b5-8c69-3141bb85e923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:03.957980 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-c34f9932-4b94-45b5-8c69-3141bb85e923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:03.965853 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c34f9932-4b94-45b5-8c69-3141bb85e923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:03.966207 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c34f9932-4b94-45b5-8c69-3141bb85e923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:03.967323 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c34f9932-4b94-45b5-8c69-3141bb85e923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:03.968045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-c34f9932-4b94-45b5-8c69-3141bb85e923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:04.108905 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-c34f9932-4b94-45b5-8c69-3141bb85e923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:04.117315 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-c34f9932-4b94-45b5-8c69-3141bb85e923 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1362 microversion: 2.1 time: 0.163961 Jun 23 08:37:04.118160 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 651/1289] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:03 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:04.263137 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-5ff995ed-bb3d-48ca-9247-e031bc41e0e0 req-a9cde804-f357-4ceb-b45b-0b74e9e0ad7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e79982-f5c6-4e6f-9bfd-b94844318982", "tag": "b4a7aa2c-5f10-4560-8465-2b94ca96a696"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:37:04.272821 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-5ff995ed-bb3d-48ca-9247-e031bc41e0e0 req-a9cde804-f357-4ceb-b45b-0b74e9e0ad7e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:04.273428 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-5ff995ed-bb3d-48ca-9247-e031bc41e0e0 req-a9cde804-f357-4ceb-b45b-0b74e9e0ad7e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:04.290776 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-5ff995ed-bb3d-48ca-9247-e031bc41e0e0 req-a9cde804-f357-4ceb-b45b-0b74e9e0ad7e service nova] Creating event network-changed:b4a7aa2c-5f10-4560-8465-2b94ca96a696 for instance a2e79982-f5c6-4e6f-9bfd-b94844318982 on hv-cinder-84721 Jun 23 08:37:04.296428 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-5ff995ed-bb3d-48ca-9247-e031bc41e0e0 req-a9cde804-f357-4ceb-b45b-0b74e9e0ad7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037815 Jun 23 08:37:04.297063 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 639/1290] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:37:05.135728 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2b31e0bf-b856-4034-8830-94ac5280db24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:05.136346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2b31e0bf-b856-4034-8830-94ac5280db24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:05.143479 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b31e0bf-b856-4034-8830-94ac5280db24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:05.143921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b31e0bf-b856-4034-8830-94ac5280db24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:05.144678 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b31e0bf-b856-4034-8830-94ac5280db24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:05.145107 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2b31e0bf-b856-4034-8830-94ac5280db24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:05.286875 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2b31e0bf-b856-4034-8830-94ac5280db24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:05.294497 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2b31e0bf-b856-4034-8830-94ac5280db24 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1362 microversion: 2.1 time: 0.162925 Jun 23 08:37:05.295130 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 652/1291] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:05 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:06.317700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c3f9b8f9-5504-4b6d-a35a-741ae7e9b089 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:06.318877 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c3f9b8f9-5504-4b6d-a35a-741ae7e9b089 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:06.329046 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3f9b8f9-5504-4b6d-a35a-741ae7e9b089 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:06.329495 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3f9b8f9-5504-4b6d-a35a-741ae7e9b089 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:06.330288 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3f9b8f9-5504-4b6d-a35a-741ae7e9b089 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:06.330719 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c3f9b8f9-5504-4b6d-a35a-741ae7e9b089 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:06.474013 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c3f9b8f9-5504-4b6d-a35a-741ae7e9b089 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:06.481951 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c3f9b8f9-5504-4b6d-a35a-741ae7e9b089 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1362 microversion: 2.1 time: 0.172385 Jun 23 08:37:06.482527 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 640/1292] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:06 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:07.500491 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-ccfefece-7a32-476a-91f9-1f0616e42a3c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:07.501067 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-ccfefece-7a32-476a-91f9-1f0616e42a3c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:07.507514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ccfefece-7a32-476a-91f9-1f0616e42a3c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:07.507953 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ccfefece-7a32-476a-91f9-1f0616e42a3c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:07.508732 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ccfefece-7a32-476a-91f9-1f0616e42a3c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:07.509143 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-ccfefece-7a32-476a-91f9-1f0616e42a3c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:07.638339 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-ccfefece-7a32-476a-91f9-1f0616e42a3c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:07.646462 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-ccfefece-7a32-476a-91f9-1f0616e42a3c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1362 microversion: 2.1 time: 0.151063 Jun 23 08:37:07.647016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 653/1293] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:07 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:08.667840 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a694cdd9-88b9-40c9-a4ed-5a8bffd50e35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:08.668820 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a694cdd9-88b9-40c9-a4ed-5a8bffd50e35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:08.676588 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a694cdd9-88b9-40c9-a4ed-5a8bffd50e35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:08.677007 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a694cdd9-88b9-40c9-a4ed-5a8bffd50e35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:08.677767 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a694cdd9-88b9-40c9-a4ed-5a8bffd50e35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:08.678193 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a694cdd9-88b9-40c9-a4ed-5a8bffd50e35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:08.816524 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a694cdd9-88b9-40c9-a4ed-5a8bffd50e35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:08.828136 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a694cdd9-88b9-40c9-a4ed-5a8bffd50e35 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1362 microversion: 2.1 time: 0.166429 Jun 23 08:37:08.828784 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 641/1294] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:08 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:09.678266 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-f5e3e9ca-857b-474c-9201-d12d605dbbb4 req-92cca445-0151-48bc-9e5d-a36e540ad5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e79982-f5c6-4e6f-9bfd-b94844318982", "name": "network-vif-plugged", "status": "completed", "tag": "b4a7aa2c-5f10-4560-8465-2b94ca96a696"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:37:09.689296 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-f5e3e9ca-857b-474c-9201-d12d605dbbb4 req-92cca445-0151-48bc-9e5d-a36e540ad5a1 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:09.689736 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-f5e3e9ca-857b-474c-9201-d12d605dbbb4 req-92cca445-0151-48bc-9e5d-a36e540ad5a1 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:09.701818 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-f5e3e9ca-857b-474c-9201-d12d605dbbb4 req-92cca445-0151-48bc-9e5d-a36e540ad5a1 service nova] Creating event network-vif-plugged:b4a7aa2c-5f10-4560-8465-2b94ca96a696 for instance a2e79982-f5c6-4e6f-9bfd-b94844318982 on hv-cinder-84721 Jun 23 08:37:09.706907 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-f5e3e9ca-857b-474c-9201-d12d605dbbb4 req-92cca445-0151-48bc-9e5d-a36e540ad5a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032324 Jun 23 08:37:09.707577 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 654/1295] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:37:09.847714 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-be1c7682-b425-492d-91cb-db2a22d3eca1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:09.848333 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-be1c7682-b425-492d-91cb-db2a22d3eca1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:09.855112 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be1c7682-b425-492d-91cb-db2a22d3eca1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:09.855609 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be1c7682-b425-492d-91cb-db2a22d3eca1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:09.856368 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be1c7682-b425-492d-91cb-db2a22d3eca1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:09.856797 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-be1c7682-b425-492d-91cb-db2a22d3eca1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:10.045204 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-be1c7682-b425-492d-91cb-db2a22d3eca1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:10.053178 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-be1c7682-b425-492d-91cb-db2a22d3eca1 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1362 microversion: 2.1 time: 0.209364 Jun 23 08:37:10.053772 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 642/1296] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:09 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:11.075838 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2ff1f454-d8d6-462e-97d2-eb7177b109c8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:11.076998 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2ff1f454-d8d6-462e-97d2-eb7177b109c8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:11.087844 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ff1f454-d8d6-462e-97d2-eb7177b109c8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:11.088551 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ff1f454-d8d6-462e-97d2-eb7177b109c8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:11.089815 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ff1f454-d8d6-462e-97d2-eb7177b109c8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:11.090539 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ff1f454-d8d6-462e-97d2-eb7177b109c8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:11.231255 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-2ff1f454-d8d6-462e-97d2-eb7177b109c8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:11.243228 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2ff1f454-d8d6-462e-97d2-eb7177b109c8 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1362 microversion: 2.1 time: 0.174780 Jun 23 08:37:11.243916 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 655/1297] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:11 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:12.267521 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=2 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:37:12.268389 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell0:SELECT=6 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:37:12.329171 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-2714bd7c-4578-46bc-ada0-4f67223ce70d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:12.329782 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-2714bd7c-4578-46bc-ada0-4f67223ce70d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:12.336268 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2714bd7c-4578-46bc-ada0-4f67223ce70d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:12.336718 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2714bd7c-4578-46bc-ada0-4f67223ce70d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:12.337481 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2714bd7c-4578-46bc-ada0-4f67223ce70d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:12.337913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-2714bd7c-4578-46bc-ada0-4f67223ce70d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:12.480035 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-2714bd7c-4578-46bc-ada0-4f67223ce70d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:37:12.487906 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-2714bd7c-4578-46bc-ada0-4f67223ce70d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1549 microversion: 2.1 time: 0.228274 Jun 23 08:37:12.488700 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 643/1298] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:37:12 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:37:12.508921 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-62358c0c-51d7-4fdc-91ab-bea75e6e565c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:37:12.509483 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-62358c0c-51d7-4fdc-91ab-bea75e6e565c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:37:12.512078 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell0:SELECT=6 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:37:12.519047 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-62358c0c-51d7-4fdc-91ab-bea75e6e565c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:12.519512 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-62358c0c-51d7-4fdc-91ab-bea75e6e565c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:12.520272 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-62358c0c-51d7-4fdc-91ab-bea75e6e565c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:12.520701 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-62358c0c-51d7-4fdc-91ab-bea75e6e565c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:12.600300 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-62358c0c-51d7-4fdc-91ab-bea75e6e565c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094794 Jun 23 08:37:12.601153 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 656/1299] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 08:37:12 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:37:13.550886 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-a152d702-cb1d-4043-9fbd-c46e76d811c8 req-cc9702d5-3412-4e55-ad7d-9aa9abf2a48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e79982-f5c6-4e6f-9bfd-b94844318982", "tag": "b4a7aa2c-5f10-4560-8465-2b94ca96a696"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:37:13.559840 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-a152d702-cb1d-4043-9fbd-c46e76d811c8 req-cc9702d5-3412-4e55-ad7d-9aa9abf2a48e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:37:13.560246 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-a152d702-cb1d-4043-9fbd-c46e76d811c8 req-cc9702d5-3412-4e55-ad7d-9aa9abf2a48e service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:37:13.572202 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-a152d702-cb1d-4043-9fbd-c46e76d811c8 req-cc9702d5-3412-4e55-ad7d-9aa9abf2a48e service nova] Creating event network-changed:b4a7aa2c-5f10-4560-8465-2b94ca96a696 for instance a2e79982-f5c6-4e6f-9bfd-b94844318982 on hv-cinder-84721 Jun 23 08:37:13.577425 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-a152d702-cb1d-4043-9fbd-c46e76d811c8 req-cc9702d5-3412-4e55-ad7d-9aa9abf2a48e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030421 Jun 23 08:37:13.578120 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 644/1300] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:18.201087 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:38:18.201855 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG dbcounter [-] [117758] Writing DB stats nova_cell1:SELECT=49 {{(pid=117758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:38:18.207880 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-b5a0c8fd-0a09-4832-b588-f7f0e045e3d4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:18.208596 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-b5a0c8fd-0a09-4832-b588-f7f0e045e3d4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:18.216579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b5a0c8fd-0a09-4832-b588-f7f0e045e3d4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:18.217107 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b5a0c8fd-0a09-4832-b588-f7f0e045e3d4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:18.217990 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b5a0c8fd-0a09-4832-b588-f7f0e045e3d4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:18.218413 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-b5a0c8fd-0a09-4832-b588-f7f0e045e3d4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:18.242950 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-b5a0c8fd-0a09-4832-b588-f7f0e045e3d4 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/ips" status: 200 len: 146 microversion: 2.1 time: 0.044200 Jun 23 08:38:18.243549 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 657/1301] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 08:38:18 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:19.568766 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:38:19.569564 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG dbcounter [-] [117757] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:38:19.574327 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-97bfe240-b712-425b-81b6-47f7a4f1af7d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd75b71f-aecb-4eb2-8f1c-aad1b687a397"}} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:38:19.575582 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-97bfe240-b712-425b-81b6-47f7a4f1af7d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:19.583294 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-97bfe240-b712-425b-81b6-47f7a4f1af7d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:19.583740 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-97bfe240-b712-425b-81b6-47f7a4f1af7d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:19.584603 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-97bfe240-b712-425b-81b6-47f7a4f1af7d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:19.585044 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-97bfe240-b712-425b-81b6-47f7a4f1af7d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:19.876725 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-97bfe240-b712-425b-81b6-47f7a4f1af7d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309920 Jun 23 08:38:19.877504 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 645/1302] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:38:19 2022] POST /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:27.437045 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-e84d7c77-aa0a-4620-b995-358934b4db07 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:27.438199 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-e84d7c77-aa0a-4620-b995-358934b4db07 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:27.447989 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e84d7c77-aa0a-4620-b995-358934b4db07 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:27.448518 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e84d7c77-aa0a-4620-b995-358934b4db07 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:27.449278 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e84d7c77-aa0a-4620-b995-358934b4db07 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:27.449702 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-e84d7c77-aa0a-4620-b995-358934b4db07 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:27.478008 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-e84d7c77-aa0a-4620-b995-358934b4db07 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047128 Jun 23 08:38:27.478544 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 658/1303] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:38:27 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:27.489716 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-5c12cf25-b8d8-4f73-9993-abf506a9f9c2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:27.490289 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-5c12cf25-b8d8-4f73-9993-abf506a9f9c2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:27.500250 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5c12cf25-b8d8-4f73-9993-abf506a9f9c2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:27.500866 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5c12cf25-b8d8-4f73-9993-abf506a9f9c2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:27.502029 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5c12cf25-b8d8-4f73-9993-abf506a9f9c2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:27.502666 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-5c12cf25-b8d8-4f73-9993-abf506a9f9c2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:27.532090 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-5c12cf25-b8d8-4f73-9993-abf506a9f9c2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/dd75b71f-aecb-4eb2-8f1c-aad1b687a397" status: 200 len: 194 microversion: 2.1 time: 0.047278 Jun 23 08:38:27.532704 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 646/1304] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 23 08:38:27 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/dd75b71f-aecb-4eb2-8f1c-aad1b687a397 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:28.871017 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-a81f8b35-48ef-47d5-be4c-905945f5ca8a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5c8ee20-8545-487d-9210-7d1d470a6586"}} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:38:28.872124 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-a81f8b35-48ef-47d5-be4c-905945f5ca8a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:28.878897 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a81f8b35-48ef-47d5-be4c-905945f5ca8a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:28.879389 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a81f8b35-48ef-47d5-be4c-905945f5ca8a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:28.880155 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a81f8b35-48ef-47d5-be4c-905945f5ca8a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:28.880579 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-a81f8b35-48ef-47d5-be4c-905945f5ca8a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:29.163506 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-a81f8b35-48ef-47d5-be4c-905945f5ca8a tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "POST /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296698 Jun 23 08:38:29.164121 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 659/1305] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 08:38:28 2022] POST /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:30.152484 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-de472bed-ebc2-4d98-84de-19ccf8ef47fe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:30.153093 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-de472bed-ebc2-4d98-84de-19ccf8ef47fe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:30.155816 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-4920e2ac-8e3e-4f35-b40d-7d14839f3056 req-01a9230c-1442-42b7-b709-a3b86c9d2341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5eca28d-5c90-4969-8a73-702bc7738287", "tag": "7097fd07-3267-400c-858a-3201571bf146"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:38:30.159942 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-de472bed-ebc2-4d98-84de-19ccf8ef47fe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:30.160614 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-de472bed-ebc2-4d98-84de-19ccf8ef47fe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:30.161426 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-de472bed-ebc2-4d98-84de-19ccf8ef47fe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:30.161825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-de472bed-ebc2-4d98-84de-19ccf8ef47fe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:30.165842 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-4920e2ac-8e3e-4f35-b40d-7d14839f3056 req-01a9230c-1442-42b7-b709-a3b86c9d2341 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:30.166415 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-4920e2ac-8e3e-4f35-b40d-7d14839f3056 req-01a9230c-1442-42b7-b709-a3b86c9d2341 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:30.177798 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-4920e2ac-8e3e-4f35-b40d-7d14839f3056 req-01a9230c-1442-42b7-b709-a3b86c9d2341 service nova] Creating event network-changed:7097fd07-3267-400c-858a-3201571bf146 for instance f5eca28d-5c90-4969-8a73-702bc7738287 on hv-cinder-84721 Jun 23 08:38:30.183514 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-4920e2ac-8e3e-4f35-b40d-7d14839f3056 req-01a9230c-1442-42b7-b709-a3b86c9d2341 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032819 Jun 23 08:38:30.184832 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 660/1306] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:30.187981 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-de472bed-ebc2-4d98-84de-19ccf8ef47fe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:38:30.298720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-de472bed-ebc2-4d98-84de-19ccf8ef47fe tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 204 len: 0 microversion: 2.1 time: 0.143787 Jun 23 08:38:30.298720 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 647/1307] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:38:30 2022] DELETE /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:38:30.306519 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d67062c7-201c-4a9e-bf44-b240e72a90df tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:30.307081 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d67062c7-201c-4a9e-bf44-b240e72a90df tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:30.314681 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d67062c7-201c-4a9e-bf44-b240e72a90df tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:30.315119 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d67062c7-201c-4a9e-bf44-b240e72a90df tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:30.316195 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d67062c7-201c-4a9e-bf44-b240e72a90df tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:30.316650 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d67062c7-201c-4a9e-bf44-b240e72a90df tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:30.455184 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-d67062c7-201c-4a9e-bf44-b240e72a90df tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:38:30.463148 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d67062c7-201c-4a9e-bf44-b240e72a90df tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.163548 Jun 23 08:38:30.463786 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 661/1308] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:30 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:38:31.484359 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-a3e2680e-0274-4c6a-8fbe-76bbf0c5b20b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:31.485011 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-a3e2680e-0274-4c6a-8fbe-76bbf0c5b20b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:31.492623 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a3e2680e-0274-4c6a-8fbe-76bbf0c5b20b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:31.493063 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a3e2680e-0274-4c6a-8fbe-76bbf0c5b20b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:31.493823 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a3e2680e-0274-4c6a-8fbe-76bbf0c5b20b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:31.494243 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-a3e2680e-0274-4c6a-8fbe-76bbf0c5b20b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:31.657536 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-a3e2680e-0274-4c6a-8fbe-76bbf0c5b20b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:38:31.665825 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-a3e2680e-0274-4c6a-8fbe-76bbf0c5b20b tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1568 microversion: 2.1 time: 0.188086 Jun 23 08:38:31.666385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 648/1309] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:31 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:38:32.543359 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [req-85306709-8834-4b2c-8191-403d975decb6 req-cb603875-bec1-4af9-819a-c4b138ab36d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5eca28d-5c90-4969-8a73-702bc7738287", "name": "network-vif-deleted", "tag": "7097fd07-3267-400c-858a-3201571bf146"}]} {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:38:32.552918 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-85306709-8834-4b2c-8191-403d975decb6 req-cb603875-bec1-4af9-819a-c4b138ab36d2 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:32.553356 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [req-85306709-8834-4b2c-8191-403d975decb6 req-cb603875-bec1-4af9-819a-c4b138ab36d2 service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:32.565237 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.compute.server_external_events [req-85306709-8834-4b2c-8191-403d975decb6 req-cb603875-bec1-4af9-819a-c4b138ab36d2 service nova] Creating event network-vif-deleted:7097fd07-3267-400c-858a-3201571bf146 for instance f5eca28d-5c90-4969-8a73-702bc7738287 on hv-cinder-84721 Jun 23 08:38:32.570178 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [req-85306709-8834-4b2c-8191-403d975decb6 req-cb603875-bec1-4af9-819a-c4b138ab36d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030859 Jun 23 08:38:32.570783 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 662/1310] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:32.684242 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-319ff7d1-842b-4b76-a413-17202356329f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:32.685455 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-319ff7d1-842b-4b76-a413-17202356329f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:32.692716 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-319ff7d1-842b-4b76-a413-17202356329f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:32.693223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-319ff7d1-842b-4b76-a413-17202356329f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:32.694197 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-319ff7d1-842b-4b76-a413-17202356329f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:32.694686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-319ff7d1-842b-4b76-a413-17202356329f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:32.762698 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-319ff7d1-842b-4b76-a413-17202356329f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb79dd547c04d2eac6dc1e35311bd9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a447448dde4ecd80717993f58f33a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:38:32.770484 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-319ff7d1-842b-4b76-a413-17202356329f tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 200 len: 1219 microversion: 2.1 time: 0.090699 Jun 23 08:38:32.771041 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 649/1311] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:32 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:38:33.792025 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:33.792779 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] [instance: f5eca28d-5c90-4969-8a73-702bc7738287] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:33.801657 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:33.802249 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:33.803253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:33.803881 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:33.819232 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] HTTP exception thrown: Instance f5eca28d-5c90-4969-8a73-702bc7738287 could not be found. Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Request method failure captured: Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 HTTP/1.1 Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCVGk0CMcNnqMgpr8ST6GcqoocluZDjSfq0l3Mww8rYgupruSOCcuGXbM_tELJH1Kl_rPryH9-iy3rpuayo4gxMAmWUUr4OZII7OmP2mR8KpmBCMRmzPBw2ifHnl3eFJf4mGN22bN3qlz_tscEvnw_ZhjwF-fBFWCKx2XY9ShPKZhyI Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: 86a447448dde4ecd80717993f58f33a7 Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-TestShelveInstance-1298796731 Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:38:33.820873 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_86a447448dde4ecd80717993f58f33a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/86a447448dde4ecd80717993f58f33a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86a447448dde4ecd80717993f58f33a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86a447448dde4ecd80717993f58f33a7"}]}] Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-TestShelveInstance-1298796731 Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: 86a447448dde4ecd80717993f58f33a7 Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-TestShelveInstance-1298796731 Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-TestShelveInstance-1298796731-project Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 1eb79dd547c04d2eac6dc1e35311bd9c Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-TestShelveInstance-1298796731-project Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance f5eca28d-5c90-4969-8a73-702bc7738287 could not be found. Jun 23 08:38:33.822822 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'f5eca28d-5c90-4969-8a73-702bc7738287'} Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5eca28d-5c90-4969-8a73-702bc7738287 could not be found. Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:38:33.824113 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5eca28d-5c90-4969-8a73-702bc7738287 could not be found. Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5eca28d-5c90-4969-8a73-702bc7738287 could not be found. Jun 23 08:38:33.825794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:33.827465 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Returning 404 to user: Instance f5eca28d-5c90-4969-8a73-702bc7738287 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:38:33.827465 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-796b1752-6542-4c89-9daf-e31290b05d77 tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287" status: 404 len: 111 microversion: 2.1 time: 0.036650 Jun 23 08:38:33.827465 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 663/1312] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:33 2022] GET /compute/v2.1/servers/f5eca28d-5c90-4969-8a73-702bc7738287 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:38:34.006346 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-6652da26-bf4f-48c8-a512-edd01109d5eb tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] Calling method '.version_select at 0x7feb6b75a280>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:34.026347 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-6652da26-bf4f-48c8-a512-edd01109d5eb tempest-TestShelveInstance-1298796731 tempest-TestShelveInstance-1298796731-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1380896725" status: 202 len: 0 microversion: 2.1 time: 0.023950 Jun 23 08:38:34.026968 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 650/1313] 10.222.0.33 () {58 vars in 1253 bytes} [Thu Jun 23 08:38:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1380896725 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:38:36.706110 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-2ef483f0-ec47-49b3-ae65-2bc3d943fb9c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:36.707030 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-2ef483f0-ec47-49b3-ae65-2bc3d943fb9c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:36.714016 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ef483f0-ec47-49b3-ae65-2bc3d943fb9c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:36.714453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ef483f0-ec47-49b3-ae65-2bc3d943fb9c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:36.715226 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ef483f0-ec47-49b3-ae65-2bc3d943fb9c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:36.715670 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-2ef483f0-ec47-49b3-ae65-2bc3d943fb9c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:36.746120 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-2ef483f0-ec47-49b3-ae65-2bc3d943fb9c tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044299 Jun 23 08:38:36.746673 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 664/1314] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:38:36 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 08:38:36.928321 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-bf101cf3-a4ef-4440-8e96-0be599ae6036 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:36.928921 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-bf101cf3-a4ef-4440-8e96-0be599ae6036 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:36.938913 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf101cf3-a4ef-4440-8e96-0be599ae6036 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:36.939404 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf101cf3-a4ef-4440-8e96-0be599ae6036 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:36.940381 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf101cf3-a4ef-4440-8e96-0be599ae6036 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:36.940929 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-bf101cf3-a4ef-4440-8e96-0be599ae6036 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:36.974258 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-bf101cf3-a4ef-4440-8e96-0be599ae6036 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/dd75b71f-aecb-4eb2-8f1c-aad1b687a397" status: 200 len: 194 microversion: 2.1 time: 0.051203 Jun 23 08:38:36.974867 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 651/1315] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 23 08:38:36 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/dd75b71f-aecb-4eb2-8f1c-aad1b687a397 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:36.984998 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-d2e14f07-9dfe-4fb4-a294-6aadf4607d72 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:36.985486 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-d2e14f07-9dfe-4fb4-a294-6aadf4607d72 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:36.992714 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2e14f07-9dfe-4fb4-a294-6aadf4607d72 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:36.993154 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2e14f07-9dfe-4fb4-a294-6aadf4607d72 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:36.993919 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2e14f07-9dfe-4fb4-a294-6aadf4607d72 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:36.994346 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-d2e14f07-9dfe-4fb4-a294-6aadf4607d72 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:37.088913 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-d2e14f07-9dfe-4fb4-a294-6aadf4607d72 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lazy-loading 'services' on Instance uuid a2e79982-f5c6-4e6f-9bfd-b94844318982 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:38:37.200845 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-d2e14f07-9dfe-4fb4-a294-6aadf4607d72 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/dd75b71f-aecb-4eb2-8f1c-aad1b687a397" status: 202 len: 0 microversion: 2.1 time: 0.219771 Jun 23 08:38:37.202021 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 665/1316] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:38:36 2022] DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/dd75b71f-aecb-4eb2-8f1c-aad1b687a397 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:38:38.393149 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-77ac4664-1a97-44de-893a-c2bb02426169 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:38.393779 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-77ac4664-1a97-44de-893a-c2bb02426169 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:38.416537 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-77ac4664-1a97-44de-893a-c2bb02426169 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:38.416984 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-77ac4664-1a97-44de-893a-c2bb02426169 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:38.418127 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-77ac4664-1a97-44de-893a-c2bb02426169 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:38.418794 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-77ac4664-1a97-44de-893a-c2bb02426169 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:38.472874 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-77ac4664-1a97-44de-893a-c2bb02426169 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/f5c8ee20-8545-487d-9210-7d1d470a6586" status: 200 len: 194 microversion: 2.1 time: 0.084028 Jun 23 08:38:38.474513 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 652/1317] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 23 08:38:38 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/f5c8ee20-8545-487d-9210-7d1d470a6586 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:38.484794 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-684cb586-3aeb-40e4-a4a1-62b6bc9bdfda tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:38.488781 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-684cb586-3aeb-40e4-a4a1-62b6bc9bdfda tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:38.496456 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-684cb586-3aeb-40e4-a4a1-62b6bc9bdfda tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:38.497204 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-684cb586-3aeb-40e4-a4a1-62b6bc9bdfda tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:38.498502 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-684cb586-3aeb-40e4-a4a1-62b6bc9bdfda tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:38.499142 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-684cb586-3aeb-40e4-a4a1-62b6bc9bdfda tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:38.605453 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.objects.instance [None req-684cb586-3aeb-40e4-a4a1-62b6bc9bdfda tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lazy-loading 'services' on Instance uuid a2e79982-f5c6-4e6f-9bfd-b94844318982 {{(pid=117758) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 08:38:38.685705 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-684cb586-3aeb-40e4-a4a1-62b6bc9bdfda tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/f5c8ee20-8545-487d-9210-7d1d470a6586" status: 202 len: 0 microversion: 2.1 time: 0.204610 Jun 23 08:38:38.686308 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 666/1318] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 08:38:38 2022] DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments/f5c8ee20-8545-487d-9210-7d1d470a6586 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:38:39.854223 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-26ab5995-fb1d-4fc5-aba0-815cc8f37691 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:39.854875 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-26ab5995-fb1d-4fc5-aba0-815cc8f37691 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:39.868143 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26ab5995-fb1d-4fc5-aba0-815cc8f37691 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:39.868584 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26ab5995-fb1d-4fc5-aba0-815cc8f37691 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:39.869382 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26ab5995-fb1d-4fc5-aba0-815cc8f37691 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:39.870157 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-26ab5995-fb1d-4fc5-aba0-815cc8f37691 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:39.903781 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-26ab5995-fb1d-4fc5-aba0-815cc8f37691 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056078 Jun 23 08:38:39.904328 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 653/1319] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:38:39 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:38:40.019599 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-89597796-18ff-4e5e-9d18-6fad1c8c0b76 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:40.021334 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-89597796-18ff-4e5e-9d18-6fad1c8c0b76 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:40.027994 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89597796-18ff-4e5e-9d18-6fad1c8c0b76 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:40.028466 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89597796-18ff-4e5e-9d18-6fad1c8c0b76 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:40.029224 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89597796-18ff-4e5e-9d18-6fad1c8c0b76 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:40.029651 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-89597796-18ff-4e5e-9d18-6fad1c8c0b76 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:40.060580 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-89597796-18ff-4e5e-9d18-6fad1c8c0b76 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045772 Jun 23 08:38:40.061749 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 667/1320] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 08:38:40 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 08:38:40.140672 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-8040a4dc-d483-4268-872f-4d7ddb4db64b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:40.141255 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8040a4dc-d483-4268-872f-4d7ddb4db64b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:40.147753 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8040a4dc-d483-4268-872f-4d7ddb4db64b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:40.148198 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8040a4dc-d483-4268-872f-4d7ddb4db64b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:40.148956 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8040a4dc-d483-4268-872f-4d7ddb4db64b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:40.149379 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-8040a4dc-d483-4268-872f-4d7ddb4db64b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:40.175281 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-8040a4dc-d483-4268-872f-4d7ddb4db64b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Going to try to terminate instance {{(pid=117757) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 08:38:40.277743 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-8040a4dc-d483-4268-872f-4d7ddb4db64b tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 204 len: 0 microversion: 2.1 time: 0.139572 Jun 23 08:38:40.280209 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 654/1321] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:38:40 2022] DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 08:38:40.288320 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-51a164bb-33f1-4f44-a561-0463e961116d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:40.289183 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-51a164bb-33f1-4f44-a561-0463e961116d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:40.299292 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51a164bb-33f1-4f44-a561-0463e961116d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:40.300009 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51a164bb-33f1-4f44-a561-0463e961116d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:40.300963 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51a164bb-33f1-4f44-a561-0463e961116d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:40.302048 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-51a164bb-33f1-4f44-a561-0463e961116d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:40.470191 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-51a164bb-33f1-4f44-a561-0463e961116d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:38:40.479201 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-51a164bb-33f1-4f44-a561-0463e961116d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1673 microversion: 2.1 time: 0.194845 Jun 23 08:38:40.479827 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 668/1322] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:40 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 08:38:41.497607 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c93318aa-5097-49df-99bc-7f348628b3e7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:41.498342 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-c93318aa-5097-49df-99bc-7f348628b3e7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:41.504931 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c93318aa-5097-49df-99bc-7f348628b3e7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:41.505634 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c93318aa-5097-49df-99bc-7f348628b3e7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:41.506378 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c93318aa-5097-49df-99bc-7f348628b3e7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:41.506801 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-c93318aa-5097-49df-99bc-7f348628b3e7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:41.646419 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.policy [None req-c93318aa-5097-49df-99bc-7f348628b3e7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117757) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:38:41.655832 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c93318aa-5097-49df-99bc-7f348628b3e7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1673 microversion: 2.1 time: 0.162872 Jun 23 08:38:41.656420 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 655/1323] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:41 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:38:42.673338 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-0c1f41e1-f52f-4926-82cb-d13e3df240a9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:42.673961 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-0c1f41e1-f52f-4926-82cb-d13e3df240a9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:42.680590 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c1f41e1-f52f-4926-82cb-d13e3df240a9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:42.681039 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c1f41e1-f52f-4926-82cb-d13e3df240a9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:42.681801 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c1f41e1-f52f-4926-82cb-d13e3df240a9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:42.682227 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-0c1f41e1-f52f-4926-82cb-d13e3df240a9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:42.814040 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.policy [None req-0c1f41e1-f52f-4926-82cb-d13e3df240a9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab1ccac328d47c99119b8205cabfedd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27862b1b0f2434d86d6af9998716432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117758) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 08:38:42.822072 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-0c1f41e1-f52f-4926-82cb-d13e3df240a9 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 200 len: 1673 microversion: 2.1 time: 0.152701 Jun 23 08:38:42.822638 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 669/1324] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:42 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 08:38:43.298302 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [req-ae77ecfd-7fb2-4d5c-a07b-cdb7bc0573e3 req-c87215c3-35e8-47a4-8f0b-d07023cc1d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e79982-f5c6-4e6f-9bfd-b94844318982", "name": "network-vif-deleted", "tag": "b4a7aa2c-5f10-4560-8465-2b94ca96a696"}]} {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 08:38:43.307891 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-ae77ecfd-7fb2-4d5c-a07b-cdb7bc0573e3 req-c87215c3-35e8-47a4-8f0b-d07023cc1d7c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:43.308345 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [req-ae77ecfd-7fb2-4d5c-a07b-cdb7bc0573e3 req-c87215c3-35e8-47a4-8f0b-d07023cc1d7c service nova] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:43.319754 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.compute.server_external_events [req-ae77ecfd-7fb2-4d5c-a07b-cdb7bc0573e3 req-c87215c3-35e8-47a4-8f0b-d07023cc1d7c service nova] Creating event network-vif-deleted:b4a7aa2c-5f10-4560-8465-2b94ca96a696 for instance a2e79982-f5c6-4e6f-9bfd-b94844318982 on hv-cinder-84721 Jun 23 08:38:43.324560 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [req-ae77ecfd-7fb2-4d5c-a07b-cdb7bc0573e3 req-c87215c3-35e8-47a4-8f0b-d07023cc1d7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029910 Jun 23 08:38:43.328338 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 656/1325] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 08:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 08:38:43.839637 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:43.840940 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:43.848457 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:43.848903 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:43.849707 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:43.850131 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:43.865133 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] HTTP exception thrown: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Request method failure captured: Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 HTTP/1.1 Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCUMM9Q7O7rIF1bj8Lc8E9su-uMlQ-Cf6bMvRaF56eW7N4LCt27pb73YyH4d_SbhTZuwFrifQdw65rs3kHc5l8cj-N9YcWd3621ZiTZbcbri_7E5AZSabpqGxGnuytoE98yuDjHtwQyWrh-T3YQPcaQr__UbXyt3_zR2IayM1EJ9qpU Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:38:43.866792 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e27862b1b0f2434d86d6af9998716432", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}] Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 4ab1ccac328d47c99119b8205cabfedd Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:43.868671 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'a2e79982-f5c6-4e6f-9bfd-b94844318982'} Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:38:43.869981 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:43.871648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:43.873641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Returning 404 to user: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:38:43.873641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-009eae14-fb79-4660-94b0-6fdd32b8c0a7 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 404 len: 111 microversion: 2.1 time: 0.032718 Jun 23 08:38:43.873641 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 670/1326] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:43 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:38:43.879420 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-c8ce060d-0a89-4f79-a7dd-7c0c9c7c1837 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '.version_select at 0x7feb6818eaf0>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:43.898990 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-c8ce060d-0a89-4f79-a7dd-7c0c9c7c1837 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-773430328" status: 202 len: 0 microversion: 2.1 time: 0.023658 Jun 23 08:38:43.899796 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 657/1327] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 23 08:38:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-773430328 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 08:38:46.823396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:46.823949 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:46.830991 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:46.831438 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:46.832196 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:46.832625 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:46.848293 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] HTTP exception thrown: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Request method failure captured: Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 HTTP/1.1 Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCUMM9Q7O7rIF1bj8Lc8E9su-uMlQ-Cf6bMvRaF56eW7N4LCt27pb73YyH4d_SbhTZuwFrifQdw65rs3kHc5l8cj-N9YcWd3621ZiTZbcbri_7E5AZSabpqGxGnuytoE98yuDjHtwQyWrh-T3YQPcaQr__UbXyt3_zR2IayM1EJ9qpU Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:38:46.849820 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e27862b1b0f2434d86d6af9998716432", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}] Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 4ab1ccac328d47c99119b8205cabfedd Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.851494 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': 'a2e79982-f5c6-4e6f-9bfd-b94844318982'} Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:38:46.852396 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.853799 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.855253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Returning 404 to user: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:38:46.855253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-35c7f8a0-a36e-4d01-be9e-3bb5ca45362d tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 404 len: 111 microversion: 2.1 time: 0.031743 Jun 23 08:38:46.855253 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 671/1328] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:38:46 2022] DELETE /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:38:46.861283 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:46.862133 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: a2e79982-f5c6-4e6f-9bfd-b94844318982] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:46.868701 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:46.869147 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:46.870254 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:46.870686 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:46.884832 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] HTTP exception thrown: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Request method failure captured: Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 HTTP/1.1 Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCUMM9Q7O7rIF1bj8Lc8E9su-uMlQ-Cf6bMvRaF56eW7N4LCt27pb73YyH4d_SbhTZuwFrifQdw65rs3kHc5l8cj-N9YcWd3621ZiTZbcbri_7E5AZSabpqGxGnuytoE98yuDjHtwQyWrh-T3YQPcaQr__UbXyt3_zR2IayM1EJ9qpU Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:38:46.886460 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e27862b1b0f2434d86d6af9998716432", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}] Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 4ab1ccac328d47c99119b8205cabfedd Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.888194 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': 'a2e79982-f5c6-4e6f-9bfd-b94844318982'} Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:38:46.889385 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. Jun 23 08:38:46.891083 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:46.892883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Returning 404 to user: Instance a2e79982-f5c6-4e6f-9bfd-b94844318982 could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:38:46.892883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-d7d86e90-1814-4b66-9b8f-126a068c5674 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982" status: 404 len: 111 microversion: 2.1 time: 0.031521 Jun 23 08:38:46.892883 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 658/1329] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:46 2022] GET /compute/v2.1/servers/a2e79982-f5c6-4e6f-9bfd-b94844318982 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:38:48.032920 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:48.033459 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.compute.api [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117758) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:48.040477 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:48.040923 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:48.041695 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:48.042171 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG oslo_concurrency.lockutils [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:48.056379 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.wsgi [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] HTTP exception thrown: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Request method failure captured: Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: request: DELETE /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f HTTP/1.1 Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept: application/json Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Accept-Encoding: identity Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Connection: close Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Length: 0 Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Content-Type: application/json Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Host: 10.222.0.33 Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Openstack-System-Scope: None Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: User-Agent: python-urllib3/1.26.9 Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Auth-Token: gAAAAABitCUMM9Q7O7rIF1bj8Lc8E9su-uMlQ-Cf6bMvRaF56eW7N4LCt27pb73YyH4d_SbhTZuwFrifQdw65rs3kHc5l8cj-N9YcWd3621ZiTZbcbri_7E5AZSabpqGxGnuytoE98yuDjHtwQyWrh-T3YQPcaQr__UbXyt3_zR2IayM1EJ9qpU Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Id: None Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Domain-Name: None Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Identity-Status: Confirmed Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Is-Admin-Project: True Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Id: default Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Domain-Name: Default Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Project-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Role: member,reader Jun 23 08:38:48.057915 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Roles: member,reader Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e27862b1b0f2434d86d6af9998716432", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}] Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-Tenant-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Id: default Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Domain-Name: Default Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Id: 4ab1ccac328d47c99119b8205cabfedd Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: X-User-Name: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: method: > Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: exception: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.059648 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: action_args: {'id': '23522f32-f998-4da9-becd-a9025e7aa51f'} Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: {{(pid=117758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:38:48.060541 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.062333 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.063789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: DEBUG nova.api.openstack.wsgi [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Returning 404 to user: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. {{(pid=117758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:38:48.063789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO nova.api.openstack.requestlog [None req-6ff062c3-dae2-408f-8923-80da9ca2b050 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 404 len: 111 microversion: 2.1 time: 0.030825 Jun 23 08:38:48.063789 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: [pid: 117758|app: 0|req: 672/1330] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 08:38:48 2022] DELETE /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:38:48.068386 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Calling method '>' {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 08:38:48.069004 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.compute.api [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] [instance: 23522f32-f998-4da9-becd-a9025e7aa51f] Fetching instance by UUID {{(pid=117757) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 08:38:48.075736 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:48.076406 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:48.077048 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 08:38:48.077478 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG oslo_concurrency.lockutils [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Lock "57905a20-3dbc-4820-af6f-859fc1a10707" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 08:38:48.091245 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.wsgi [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] HTTP exception thrown: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Request method failure captured: Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: request: GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f HTTP/1.1 Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept: application/json Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Accept-Encoding: identity Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Connection: close Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Length: 0 Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Content-Type: application/json Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Host: 10.222.0.33 Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Openstack-System-Scope: None Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: User-Agent: python-urllib3/1.26.9 Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Auth-Token: gAAAAABitCUMM9Q7O7rIF1bj8Lc8E9su-uMlQ-Cf6bMvRaF56eW7N4LCt27pb73YyH4d_SbhTZuwFrifQdw65rs3kHc5l8cj-N9YcWd3621ZiTZbcbri_7E5AZSabpqGxGnuytoE98yuDjHtwQyWrh-T3YQPcaQr__UbXyt3_zR2IayM1EJ9qpU Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Id: None Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Domain-Name: None Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Identity-Status: Confirmed Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Is-Admin-Project: True Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Id: default Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Domain-Name: Default Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Project-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Role: member,reader Jun 23 08:38:48.092809 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Roles: member,reader Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e27862b1b0f2434d86d6af9998716432", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e27862b1b0f2434d86d6af9998716432"}]}] Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Id: e27862b1b0f2434d86d6af9998716432 Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-Tenant-Name: tempest-AttachVolumeTestJSON-334393664 Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Id: default Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Domain-Name: Default Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Id: 4ab1ccac328d47c99119b8205cabfedd Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: X-User-Name: tempest-AttachVolumeTestJSON-334393664-project Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: method: > Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: exception: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.094538 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: action_args: {'id': '23522f32-f998-4da9-becd-a9025e7aa51f'} Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: {{(pid=117757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 08:38:48.095744 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. Jun 23 08:38:48.097689 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: ERROR nova.api.openstack.wsgi Jun 23 08:38:48.099496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: DEBUG nova.api.openstack.wsgi [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] Returning 404 to user: Instance 23522f32-f998-4da9-becd-a9025e7aa51f could not be found. {{(pid=117757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 08:38:48.099496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO nova.api.openstack.requestlog [None req-db4cdf51-167b-4aa9-9aac-62e62c73b2f2 tempest-AttachVolumeTestJSON-334393664 tempest-AttachVolumeTestJSON-334393664-project] 10.222.0.33 "GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f" status: 404 len: 111 microversion: 2.1 time: 0.029847 Jun 23 08:38:48.099496 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: [pid: 117757|app: 0|req: 659/1331] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 08:38:48 2022] GET /compute/v2.1/servers/23522f32-f998-4da9-becd-a9025e7aa51f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 08:38:48.125273 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:38:48.125478 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Thu Jun 23 08:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:40:43.478439 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:40:43.479149 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Thu Jun 23 08:40:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:40:44.187100 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:40:44.187877 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Thu Jun 23 08:40:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:41:57.811887 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:41:57.812845 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Thu Jun 23 08:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:42:02.308734 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:42:02.309813 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Thu Jun 23 08:42:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:42:04.379035 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:42:04.380028 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Thu Jun 23 08:42:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:42:08.134383 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:42:08.135536 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Thu Jun 23 08:42:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:44:03.488269 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:44:03.489305 dv-cinder-847216-2-iscsi devstack@n-api.service[117757]: Thu Jun 23 08:44:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 08:44:04.197376 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 08:44:04.198344 dv-cinder-847216-2-iscsi devstack@n-api.service[117758]: Thu Jun 23 08:44:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!